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ABSTRACT ' - 

The purpose of this study was to determine whether current Inservice 
activities fof teachers Incorporate research-valWated practices. Inservice 
programs for activities Improving students' baslcHiklll achievement were of 
particular Interest. ^ ' 

The Initial atep was to Identify dimensions f o^ describing and ^ . 
analyzing Inservice education. Twenty-seven dlmehslons were Identified and 
organized under six headings: teacher*' objectives, student objectives, 
delivery systems^ organizational context, governance, and ^ 
selection/evaluation. The dimensions were Intended to reflect the complex, 
systemic character of Inservice education and the sequential arrangement of 
Iti processes and effects*. 

Next, the research literature was reviewed to Identify InserVlte 
practices «that have had demoAsttiated effects on students' basic skill 
achievement teacher behavior, and teacher satisfaction. ^Inservice 
experiments that trained teachers In dlrfect Instruction principles ^re found 
to yield many useful findings. Research^ on curriculum and Instruction 
Implementation also suggested effective inservice practices. 

An empirical survey of two' elementary schools in each of three 
Pacific Northwest districts were undertaken in 1982. -Approximately six 
teachers in efach^school (total N »-3&), the principal of each school (total N 
• 6), and the assistant superintendent of each district (total N « 3) 
partlc^ated in extensive individual interviews t The interviews ^sought , 
descriptions aiid perceptions of ^ali inservice activities in which teachers 
had participated or that administrators had sponsored over a one-year period. 

The survey of current inservice practice yielded results disparate 
from the research-based model that emerged-»f rom the literature review. In 
this model an effective inservice program for improving basic skills 
instruction would be embedded. in a school improvement process in which the 
inservice program, assessment procedures, and curriculum and' instruction work 
together in a tightly linked fashion to achieve priority goals. The survey 
showed, however, that the majority (67 percent) of inservice activities were 
perceived as being for teachers' 4)ersonal professional improvement. ^ Onlf 18 
percent were perceived as being for school or district improvement. School 
Improvement efforts typically extend over several, years, but almost 75 • 
percent of the inservice activities extend for just oriie session^, 

Another disparity between the research-based model and current 
praokticf is that the latter is fractionated across many^goala rather than 
focused on a few priority goals. Thirty-seven percent of the activities 
concerned basic skills, but they were dispersed across many topics. - Of the 
279 inservice activities described by the teachers, just 20 included mention 
of student achievement outcomes. Only 6 percent of the activities included 
an assessment of sttident improvement or change resulting, from teachers' 
participation in the activity. Just 8 of the 279>ctivitie8 included 
reference to direct instruction strategies. 

One set of interview questions asked whether the teachers ^nd 
administrators agreed with elements of the research-based model. Both groups 



endorsed most elements » wltji administrators generally mbre favorable than 
.teachers • The majority of teachers (56 percent) had reservations about the 
use of nationally standardized or curriculum-specific tests to measure basic 
skills achlev^ent, 4nd a substantial percentage of teachers were resistant 
to some elements of direct Instruction^^ 

Teachers' {^anticipation In Inservlce education over thfe one year 
period was 73 hoars (samp^ mean) distributed across approximately 7 discrete 
activities. Also, teachers were satisfied with 80 to 90 percent of thelr^ 
activities depending upon the' dimension being rated, teachers^ high . 
participation and satisfaction rate iki^y be explalnecfTby the fact that most 
Inservlce activities '(88 'p^erc^t) are perceived as relevant to their work; 
they require little, new learning <,teachers felt adequately prepared for 63 
percent of the activities before the activity began); they are inexpensive ^ 
(78 percent Involved no out%of-pocket expense); incentives are cooiDon 
(present In 515 percent of the activities); many of them are voluntary (49 
pjercent); and most involve no assessment. Current Inservlce educlit Ion 
appears \t9 cpnslst largely of unlntruslve, comfortable experiences that 
reinforce. prevailing patterns of school work. Experiences that seek ta 
improve school worlc against measured criteria are uncommon. 

A loose coupling Interpretation of current^ inservlc^ practice Is 
suggested by the results. Many Inservlce Activities are ><i>sely coupled to 
school Improvement, student learning outcomes, and assesSBient. This 
interpretation raises questions about the purpose for Inservlce education In 
current practice. Policy makers need to consider'' how Inservlce education can 
be more tightly coupled to district-level priority goals ^nd assessment of 
goal at,talnment. 
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CHAPTER 1 
PURPOSE OF STUDY 



Overview 



The research project descdbed In this report was guided by two 
general questions^ 'First/ If educators want to help elementary .teachers 
Improve the basic ipkllls achievement of their students, thmt type of 
Inservlce program shoyld be Instituted?^ This question led us to a search for 
previously developed, effective Inservlce pii'ograms and practices. A program 
or practice was considered effective If research had demonstrated that It 
contributed to (a) teacher Implementation of the Inservlce content, (b) 
teacher and administrator satisfaction, or <c) Improved Student achievement 
In the basic skills. ' . 

The second quesclon was this— -What Is happening In current Inservlce 
^practice, and how discrepant Is It from practices for which there Is research 
evidence of effectiveness? Description of current practices provides useful ' 
baseline Information from which further research can be planned. Also, 
baseline Information Is useful to educators for planning Improvements In 
Inservlce programs to^make them more effective* 

The following project 'objectives were deprived from these questions: 

1. To develop a set of dimensions for characterizing Inservlce 
programs. 

y " - * 

2. To identify dimension-^related practices whose effective- 
ness has been demonstrated through research. 

3. To determine the extent to which research-validated in- 
service practices are present in current inservlce 
activities. \ 

4. ' To determine the extent to which teachers and admlnl- 

strators have ^ positive attitude toward research- 
^ validated inservlce practices and toward current 

insltrvicje practices. 

The first objecjtlve of the research project was achieved by a review of the 
research literature on inservlce education and ^on curri,culum implementation 
and change. The literature review and ^research-validated practices are 
described in Chapter 2. The other objectives were achieved by conducting an 
intensive interview survey of. teachers and admlnistrator|i in several school 
districts. The survey is desoribed in Chapters 3 through 5. 



Rationale for the Study ' 
• • • 

Basic sicills achievement has emerged as a priority of American 
edocatioh in the last decade or so. Achievement in the basic skills of 
reading, language arts, an4 mathematics is .a particular problenT for children 
of low*-Sj£S families and for children of various ethnic origiigis. The federal 



government has an explicit policy of supporting equal educational opportunity 
for' these children. Much of the research supported by the National Institute 
of Education (NIE)| including the present research project > Is also directed 
toward this goal. 

Probably the most basic policy and research question with respect to 
i^qxial educational opportunity Is, What c^in be done to Improve the academic 
achievement of low-'performlng students? In the paradigm developed .by the 
Center for Educational Policy and Management at the University of Oregon 
(Duckworth 1981), teacher work is seen as a central determinant of students' 
basic skill achievement. In an elaboration of' the paradigm (Hersh et al. 
1981), inservice education was seen as a major available resource^or . 
improving the effectiveness of teacher work. 

Effects of ' Inservice Education. The intent of Insertlce education, 
more than any other aspect of human resource management, is to Increas'e 
teacher effectiveness. Bruce Joyce and his colleagues have defined inservice 
education as the' "formal and informal provisions for the Improvement of 
educators as people, "j^ducated persons, and ptof esslonals, as well as in teVms 
of the competence to carry out their assigned roles" (Joyce,' Howey,^ and 
Yarger 1976, p. 6). 

Inservice education is a large, labor-intensive effort that Involves 
the expenditure of substantial school system re'sources. In 1975 it was 
estimated that "...there may be as ipany as a^ quarter of a million persons in' 
^the United States who engage as instructors in some form of XStE [inservice 
teacher education] activity — this is about one Instructor for every eighth 
teachers" (Joyce, Howey, and Yarger 1976, p. 6). At that time, too, about^ 
half of American teachers held master's degrees, representing a considerable 
investment in inservice education beyond initial certification. 

Despite 'this considerable investment in inservice education, the 
research basis for it9 effectiveness is virtually nonexistent. Most of the 
research consists of evaluating the itkimedlate effects of inservice education 
on teacher attitudes, knowledge, and behavior (Joyce and Showers 1981)-. An 
important exception is the small but growing number of studies (reviewed by 
Gage and Giaconia I98i) that have demonstrated, through controlled 
experimentation* the effects of Inservibe education on teacher capability to 
bring about improvements in student performance and achievement. These 
studies are recent; most of them were completed .in the last five years. In 
each study a group of teachers received the experimental inservice training 
while decontrol group of teachers continued their regular^^ activities. 
Following the training^phase, 'researchers observed the students of both 
groui^ over a period or time to jdetermine the effects of training on 
students' basic skills achievement. ^ ^ 

The experiments involved either basic skills instruction in reading 
(Stallings 1980; Anderson, Evertson, and Brophy 1979) or in mathematics (Good 
and Grouws 1979; Crawford et al. ■^978). In each experiment the content of 
-^he inservice program was a set of instructional techniques which in previous 
correlational research had been found to ^ correlated with measures of 
stufdient achievement (see Appendix A foir tlie content of two. of the programs). 
For example, in Good and Grouws' experiment, the instructional techniques 
taught to the experimental group were derivied from earlier correlational 
research' in which the instructional beha\^or of teache]:s who were 



' consistently effective or ineffective in obtaining student achievement 
results was compared (Good^and Grouws 1977). The techniques in this 
experiment, and in the three others cit^d above, have generally come to be ^■ 
known as "direct instruction" >(Ro86nshine ^97fr). 

Implementation Factors. Each of the inservice programs tested in 
the four experiments w6re effective in impraving students' basic skill 
achievement. The results are sufficiently consistent and potent that 
- educatoics need to think^ about incorporating the experimental inservice « - 

programs in practice. In fact, several of these inservice programs have been 
'approved for di$semina4:ion through the National Diffusion Network. This , ^ 
implementation of new inservice approaches is no simple matter, however. One 
important problem is that the format of these experimental programs is 
unspecified in many respects. For example, characteristics of the inservice 
trainer, incentives for teachers, scheduling of sessions, and recruitment of 
teachers for training are not d^alt with s^rstematlcally in the experiments. 
Yet such factors may be critical to the success of "direct Instruction" # 
inservice programs. This point is illustrated in an experiment by Coladarci ' 
(1980), who used the same content as in* the Crawford' study but with a much 
simpler inservice delivery system. Coladarci' s inservice program did not 
yield significant teacher and student ^effects. r 

Coladarci 's' study demonstrates the importance of specifying all of 
the key elements of an inservice program if it is to be effective in regular 
ijiservic^ settings. Therefore, one major purpose of our study was to review 
the research liter^tyreu to identify the pertinent elements of inservice 
pt6grams (e.g^, recruitment of teachers) and to determine which variations in 
these elements (e.g., mandatory verpus voluntary participation by teachers) 
enhance or wtaken inservice effects on teacher perfotmance and student 
achievement. 

The research on curriculum implementation and school change is t 
especially pertinent to the problem of identifying an effective inservice 

• education model. Inservice education is intended to .^be helpful, but at the 
same time it is an "innovation" that represents an intrusion iitfo a teacher's 
current work and- into a school system's current patterns of operation*. If 
.the inservice program is intrusive in a negative way, teachers may acquire /' 
new instructional skills but fail to impjemept ^em in^ their work. The 
available research on implementation and change therefore was reviewed to 

■ identify additional elements beyond those specified iri the traditional 

inservice educat-ion literature ^ ^ 

Current Inservice Practice. Inservice programs on direct 
' instruction strategies for tfKe basic skills are a relatively new development 
in teacher education. ^ If they are to be successfully introduced into scho<^ 
systems, we must have a good understanding 6f prevailing inservice practice. 
For example, there will be problems of implemei\tatioil if these programs 
require extensive training of teachers over a period of tdme, but current " ^ 
practice consists primarily of brief one-shot inservice activities. Such a ^ 
finding would reveal the lack of an existing structure tp support sustgilned 
inservice activity on a single priority goal. A similar problem of 
implementation might oc^ur if schoolteachers and administrators place higher 
priority on different student outcomes (e.g. , self-concept and attitudes) ^ 
thdn basic skills achievement. 
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It l6 important then tb develop a sound understanding of existing 
Inservlce practice as a basis for determining how to Implement the effective 
elements of Inservlce* education Identified through research. As Indicated in 
Chapter 2, descriptive studies of Inservlce practlpe have been done but they 
^re of 11ml tec| valye. Most of these studies are questionnaire surveys of 
teacher attitudes toward their Inservlce experiences. This typte of research 
does not yield objective Information aboAit the Inservlce activities In which 
teacheVs have participated, or about the extent to which the activities 
Incorporate elements Identified through research as "effective." 
Crulckshank, Lorlsh, and Thompson (1979) similarly ' observed that 
"•••Inservlce education research' has given little attention to ^descriptive 
studies; thus we know little about what aci^ually occufs during Inservlce 
programs" (p. 31). ^ , 

^ Another . characteristic of previous researcl) on Inservlce practices Is 

that It has mostly focused on descriptions of Isolated, individual l.nservlce 
programs and their immediate effects on teacher knowledge and' attltucf^s 
(Joyce and Showers 1980o). To our knowledge, no studies have .examined the 
interconnections between inservlce expe,riences received by individual 
teachers over a sjiecified time frame. It is possible that some, experiences 
have the capacity to enhance teacher pfoductivity^ but are cancelled ou^ by 
other "distractor" experiences that channel the teacher away from efforts to 
cliaAge his or her behavior with respect to basic skills Instruction, tn 
contrast, our research focused on the , individual teacher and administrator as 
the unit of study. This methodology made it possible to determine variations 
io amount and quality of inservlce activities that were actually received by 
t<$achers or sponsored by administrators over a year's period* of time. 



Research Questions 

The research project was carried out in two phases. The first phase 
involved a literature review to' answer the following questions: 

What are the pertinent dimensions' for analyzing and designing Inservlce 
programs to improve * teather capacity for delivering basic skills instruction? 

Progress in inservlce education at this point in tlgie depends upon 
•de^Asloping a more comprehensive model of its dimensions. The literature on 
inservlce education, which Includes thousands of entries in ERIC and -a 
book-length bibliography (Collins et al. 1979),, makes clear that it is a 
complex process. Content, training methods, purposes, governance, and 
organizational coirtext must be considered. Also, there ar/k complex 
interactions between inservlce elducation, lmplementatl6n strategy; and schc^ol 
improvement that need to be understood. Most importantly, the effectiveness 
of a particular ifiservice variable i.n, improving teacher and student 
[ferformance depends on how <$ther aspects of the inservlce program have been 
constituted r For example, variations in, inservlce training methods ntay have 
little effect when the criterion is student achievement: gains averaged across 
teachers, for a single school year (as was the case in the experiment by 
Crawford et al^ [1979]). Training variations may have a substantial effect, 
thWgh, when the criterion is student achievement gains for as many teachers 
as possible in g school sltc!, sustained ovet a multi-year period. 
• • ' . ■ 

We find good reasoiv to agree then with Edwards (1981), who concluded 



her revieii of the Inservlce literature with the^ statement that there is a 
need **to widen the perspective of changing teacher practice by .creating a 
more^comprehenslve conceptualization of the process of changing teacher 
practice." As we describe in Chapter 2, ve have developed a comprehensive 
model of Inservlce education in line with Edwards' recommendation. The 
cirrrent version of the model Involves 29^ dimensions. It Is an elaboration 
and restructuring, of the model developed by the staff of the Inservlce 
Teacher Education Concepts Project ^( Joyce, Howey, and Yarger 1976). 

1 

The^9 dimensions of the inservlce model provided the basis for the 
second phase of the research ^project . tHIs phase Involved an interview 
survey of teachers and administrators to answer Che following five research 
' questions: ^ 

- r . 

01. How much Inservlce education is currently received by teachers 
and sponsored .by administrators? 

Most of the research on inservlce education* has consisted qf studies 
of Individual Inservlce programs '(for example, the programs reviewed by 
Lawrence et al. [1974]). Only a few studies have looked at the individual 
teacher as. the recipient of Inservlce programs. This type of study is. 
Important for two reasons. 'First, knowledge about teacher's inservlce 
activities over a period of time would indicate whether teachers focus their 
Inservlce on a few priority topics or whether they disperse their Inservlce ^ 
efforts .over a wide range of topl<:s. Second, a complete record of a' 
teacher's Inservlce activities is rfeeded ta derive an estimate of the 
percehtage of inservlce time devoted to basic skills instruction. 

j(f2 . What percentage of > current Inservlce activities is in the area 

of basic skills instruction? • 

. ^^^^^^^ I - - 1 • t \ % 

Th^re is little research ^data about the extent to which basic skills 
* inservlce Instruction — and the form^lt took, in rw:ent experimental 
studres — is present in current practice. The one pertinent study that we 
identified j(Sull:{^ van. 1981) produced these results: "A 1977-78 audit of the 
training program designed to Improve ^he abilities of New* York City teachers 
found th^t only 10 percen^ of the programs' 303 courses were related to 
reading and mathematics, even though pupils in the public schools were 
scoring significantly Ipwer in those ^reas than they should...."' It will be 
helpful to learn whether this fin'ding is generally true of school districts. 
Descriptive data of ^this type should prove a useful "mirror" for teachers and 
policy majcers to hel^ them {determine whethepr current practice reflects 
d^lred practice;. .\ \ ' ' 

' " ' • ' • ' 

. #3. What ^form do current inservlce activities take, and how does 
thl& form compare with recommenced practice? \ 

Each of the inservlce activities identified in the present study was 
'described wit;h respect to l^ts teacher objectives^ st^udent objectives,, 
delivery ^system, organiza clonal context, and governance.' The purpose of this 
de^crip^pn was- to determine current inservlce practice so that it^could be 
compared for di'&crepancies^ with our research-based model of effective 
inservlce educat^lon for improving basic skills instruction. ' 



#4. How effective and satisfying Is current Inservlce education as 
pejrcelved by educators? , , ^ ' 

Several rjesearch studies, reviewed In Chapter 2, have addressed this 
question. However, these studies generally relied on questionnaire responses 
and are about lii$ervlce education generally. In contrast, the present study 
used interview me^thodology to. identify educators' attitudes about specific 
Inservlce .practices withi-n a recent! time period. 

Data about teacher and administrator perceptions are Important for 
understand;Lng the adaptability . of inservlce education to change and 
improvement. If educators are demonstrated to be dissatisfied with an 
Inservlce practice, policy makers may be motivated to change the practice. 
Conversely, if educators are satisfied with an inservlce practice, policy 
makers may be less likely to change it even if it conflicts with. a practice 
that is more effective. 

#5. In the opinion of educators, what constitutes an effective 
Inservlce program for Improving teachets' basic skills instruction? 

The research on curriculum implementation (Fullan and Pomfret 1977) 
indicates that teacher and adi^ihlstrator perceptions are critical to 
successful adoption of new instructional practices. For example, Eoucks and 
Pratt (1979) reached this conclusion based on their research on 
implementation processes: "Staff developers, administrators, and other 
change facilitators often attreiu^closely to the trappings and technology of 
the innovation but Ignore the perceptioiisand feelings of people. The 
personal dimension is often more criticaT^^tJ-^tlies^ of the change effort 

than are the technological dimensions" (p. 2lh). ^-..^^^^ . ' ^ 

We use the term "perceptions" to refer to such .persoital^ factors as 
beliefs, values, biases, and fears. Based on the findings of curriculum 
implementation research, we have hypothesized that the Effectiveness^ of the 
technology validated in basic skills Inservlce experiments and research on y 
school improvement is Influenced by teacher and administrator perceptions of 
this technology. For example, teachers sometimes fear that the achievement 
test scores of their students will be used to evaluate* .teachers' performance. 
Teachers also have negative feelings about Inservlce programs that are 
designed "top-down" by administrators. To the extent that teachers have such 
perceptions, they are likely to resist participating in Inservlce programs 
that are linked directly to assessment of students' basic skills .achievement . 

✓ 

There is a small amoutit of knowledge' about educator perceptions that 
may Influence the Effectiveness of research-based inservlce education, but 
much mote knowledge is needed. The p^resent research project collected 
research data pertinent to this problem. ^ 
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i CHAPTER 2 

DEVELOPING A WOPEL OF AN EFFECTIVE INSERVICE PROiGRAM 
FOR BASIC SKILLS INSTRUCTION 



.The purpose of the literature review in this project was to 
* synthesize research findings on effective inservice practices with respect to 
basic skills instruction at the elementary school level, ^e research 
findings were used to construct a mpdel of what an effeptive basic skills* 
in&ervice.^ptrogram might look like. In turn, the model was used in the 
interview survey (see Chapters 3-5) as a basis for judging the efficacy of 
current inservice practices. . - 

•The f i^st step "'J^n the literature review was to identify a set of 
generic dimensioms for characterizing inservice programs. Hhe term "program" 
is used here In £% general sen&e to refer to any self-contained inservice 
activity ranging from a "one-shot" tn^eting to a sustained process of 
professional development. ^ ^ ^ ^ 

V ■ * • ' > 

The systems framework developed by the Inservice Teacher Education 
Concepts Project (Joyce/ Howey, and' Yarger 1976) provided a useful starting 
point for creating the set of dimensions. The ISTE (Inservice Teacher 
Education) Concepts Project was a larg^-scale study carried out in 1975-1976 
under the auspices of the National Center for Education Statistics and the 
National Teacher Corps. It was designed to conceptualize the^tfucture o£ 
American inservice education and to define issues for further research. The 
project investigators found that "there are four major dimensions that take 
the form of systems that link together to«iform the operating structure which 
is ISTE" (Joyce »Howey, and Yarger 1976, p. 3). The four systems identified 
'by the ISTE Concepts Project are: 

1. Substantive system: refj^rs tdv^the content of an 
Inservite program and the process used to deliver - 
the content. 

2. Delivery system: refers to incentives, inter- ^ 
face between teacher and training, and inservice 

staffing pattern. 

. ■ ^ » * ' 

3. * Noi^el system: refers to the organizational con- ^ 

teHt in which inservice education occurs. ^ 

\ ■ * , 

4. Governance .system: refers' to the decision- ^ 
making stt^uctures which 'legitimize inseV/ice 

^ activities and govern thein. 

f> 

The majority of the dimensions' in our model were derived f rom the * 
ISTE project 's_ analysis. Another source for identifying inservice dimensions 
w;^s the research literature on curriculum implementation. ' Even if a teacher 
acquires a new set of instructldnal skills as a result of inservice 
education., this does not mean necessarily thi^ the teacher t^ill use (i.e.^ 
implement) the skills in practice. Thus, implementation of inservice 
training is an ^.mportant factor in its bwn^right. It seema reasonable to 
believe that factors which ^influence implementation wjjLll. also influence 
teacher effectiveness. 



The available. research on Implementation vas reviewed by Fullan and 
Pomf ret. (1977). Their list of determinants of ^ef f ectiye Implementation 
overlaps at some points the System variables iclentifled in the ISTET Concepts 
Project: 

A* Characteristics of the Innovation 
1. Expllcltjaess (what, when, how) 
* 2. Complexity 
B« Strategies and Tactics 

1. Inservlce training 

2. Resource support «( time and materials) 

3. Feedback mechanisms » ' 

4. Participation ^ ^ 

^Ci Characteristics of the Adopting Unit ' * 

1. Adoption process 
. ' 2. Organizational climated 

^ ' ^ 3. Enviroitmental support 
4. Political complexity 

(pp. 367-368) 

Several of these* dimensions of implementation were included in our model of 
effective implementation. 

Additional dimensions were derived from the literature on general 
inservlce education. For example, Fankratz and Martray (1981) specified an 
eight-step model for Incorporating inservlce education in the process of 

^curriculum change and'' iniprovement . Nelson (1981) described a similar model 
for using inservlce education to support the development and installation of 
new instruc^tional programs. Both models incorporate inservlce dimensions' 

^previously identified* in oiir literature search. The models also suggested 
several dimensions that were added to our list: use of needs assessments and 
relevance of content. 

Cruickshank, Lorish, and Thompson (1979) suggested that Dunkla and 
Blddle's model for conceptualizing research on teaching (Dunkin and Biddle 
1974) could be used to identify and organize inservlce education variables. 
Presage variables in Cruickshank's model represent the characteristics of 
inservlce program leaders, corresponding to the trainer dimension in our 
model. Context variables include characteristics of the teacher 
participants, the school and community setting, and the teachers' 
instructional context. Process variables in their model refer to t^e 
instructional activities in which teachers engage. This class of variables 
corresponds to the Delivery System dimensions of our model. The final part 
of Cruickshank's model involves product variables, which are the short- and 
long-term effects of inservlce education. This* set of variables corresponds 
to the Teacher Objective and Student Objective dimensions of our model. 

The literature on loose coupling (Meyer; 1981) suggests the need for 
identifying dimensions thA reflect the telationship between inservlce 
education and school organBsation arrangements for conducting administrative 
and technical functi^s. The inservlce programs tested in the four basic 
skills experiments described in Chapter 1 posit a rational, "tightly coupled" 
connection between mekns (inservlce training) and ends (student achievement 
in basic skills). The theory of ^lop^e coupling as it applies to school 



organization suggests, however, that inservice education practice is poorly 
linked ("loosely coupled") to student achievement goals and to other aspects 
of school organization.^ A set of dimensions under the ^heading Selection and* 
Evaluation was added to our model to characterize whether particular 
Inservice programs are tightly or loosely coupled to scli^ol outcomes and 
needs. 

€'he' current version of the set of dimensions that comprise the model 
i$ shoWh in Table 1. There ai^t 27 dimensions undei:^ 6 major headings. The 
headings dnd dimensions are .discussed in the next sections of the chapter. 

The second step in the literature review was to identif^v^practices 
corresponding to the dimensions that have been found to contribute to the 
effectiveness of ittservice programs for l^asic skills instruction. For 
example, with respect to the dimension of readiness activities (no. 7 in 
Table 1), we were Interested .in identifying any research that determin<&d 
whether the presence of readiness. activities-~or the presence of particular 
readiness activit Jes-.-contributed to the effectiveness of an inservice. 
program. The four inService experiments on basic skills Instruction 
described in Chapter 1 (Anderson, Evertson, and Bropby 1979; Ctdwford et al. 
IVS; Good and Grouws 1979; Stalllngs 1^0) were especially useful for 
identifying such practices. These experiments are referred to collectively 
in the rest of the chapter as the "four inservice experiments." 

Another source of successful inservice practices was^a me ta*-a.na lysis 
of research studies of' inservice progr ams conduct ed by Lawrence and Harrison 
(1980). A study was included in the^meta-analysis^if Ic "Included measured 
outcome^ of an inservice program. The outcomes could refer to teacher 
competencies (dimension 1 in our model) H>r student objectives (dimension 5). 

The effective practices identified by the literature review are 
described in the following sections and a're summarized in Table 3 at the end 
of the chapter. 

A. Teacher Objectives ^ 

Inservice education is usually defined as a change in teacher 
capacity brought about by new learning. For example, Joyce and his 
c611reagttW--(4JL76^_def^^ education as the "formal and informal . 

provisions for the impfrovemen^ of educators as people, educated persons, and 
professionals, as well as in terms of the competence to carry out their 
assigned roles" (p. 6). Inservice education attempts to improve teacher* 
capacity in three broad areas: knowledge, attitudes, and skills. We defitl# 
inservice teacher education, therefore, ^s efforts to improve teachers' ^ 
capacity to function as effective professionals by having them learn new 
knowledge, attitudes, or skills. These outcbmes const^itute the teacher 
• objectives of an inservice activity. 



1 . Target Competencies . ^ 

Each of the four inservice experiments that yielded positive outcomes 
-on m e asure s ' of basic skills achievement- emphasize teaching skills rather than 
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^ TABLE 1 

A. Set. of Dimensions for Characterizing Teitcher Education Programs 



A> ° Teacher Objectives 

1. Target competencies i\ Complexity ' 

2. -Operatlonallzatlon' . ^ 4, Expected level of performance 



^ B> Student Objectives 



i 



5. Target objectives 

6. Expected level of achievement 



C> Delivery System ' * * I 

\ , ; • ■ . 

7. Readiness activities 10. Training site 

8. Instructioni^l process 11. Trainer 

9. Maintenance and monitoring 12. Scheduling 



D, Organizational Context 



13. Purpose for participation 15. Concur i;ent organizational changes 

14. Inservice cohorts 16. Other inservlce' activities 



E. Governance ^ 



17. Goveiyaance structut^ . ' 20. Incentives 

18. Teacher participation in governance 21. Sanctions ^ 

19. Recruitment of participants o 22. Costs 



F. Evaluation 

23. Policy 26>. Measurement of teacher competence 

24. Needs assessment 27. Measurement of student objectives 

25. Relevance to partidipants ' 
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knowledge and attitudes. The content of the Inaervlce programs . In these 
studies was derived from correlational research linking specific teaching 
behaviors to measures of growth In basic skills achievement* Roehler and 
Duffy (1981) Indicated tharlr the teaching skills In these Inservlce programs 
generally can b6 classified Into two types: (1> monitoring behavior In which 
the teacher asks Ruplls to, perform a desired "basic skill" (e.g., workbook 
practice accompanied by teScher monitoring) and (2) reactive-corrective 
behavior to help a student when h^ pr she falls to malce the desired response. 
These Instructional strategies presumably are effective because they Insure a 
high engagement rate of students In academic tasks ^ 



The four Inservlce experiments involved long lls^s ol 
behavioral ly-deflned Instructional skills. (Several of the lists are in. 
Appendix A.) These skills collectively have been called a "direct 
Instruction" model (Rosenshlne 1976). Several recent studies, still in 
p*rogress, are using a more general ALT (academic learning tike) model as the 
teacher objectives of an inservlce program. In the study being done at RBS 
(Research for Better Schools) by HelmJI (described .in Rouk 1981), the five key 
instructional variables are: allocated time, engagement ralte, student 
engaged time, taking into account students' prior <3 learning, and' instructional 
overlap (i.e., the match between instructional content and achievement test 
content). HutchlAs, at Mid-Continent Regional Educational Laboratory 
(MeREL), is also currently testing the ef fectlveness*of an inservlce workshopl^ 
for increasing ALT Iq schopls (Hesdribed 'in Sally 1981). 

The last two instructional variables in Helms' inservlce program are* 
of particular Interest because they jrequire a change In teachers' curriculum 
content rather than in theif inst;ructional style Evidence on teachers' 
ability and willingness to changeNtheir curriculum content is not yet 
available from Helms' and Hutchins' research. «£tudies by. Porter and his 
colleagues (lSt81) are relevant because they indicate that teachers are quite % 
willing to change their curriculum content in response to such external 
Influences as standardized tests, principals, other teachers, and parents. 

Each of the four inservlce experiments measureS" teachers' use of the * 
Instructional skills that formed the target competencies. We should stay 
open to the possibility of other teacher changes as a res\ilt of the Inservlce 
programs. For example, an jinservice program may have effects on teacher 
self-concept or beliefs about education, even though those effects were not 
part of the formal objectives of the program. ^ These effects on teachers may 
be immediate (side-^ef fects) or may show up some months or even years after 
training (long-term). 



2. Operationaligation 

The research on curriculum implementation reviewed by Fullan ahd 
Pomfret (1977) and by Hall and Loucks (1980) 1-ndlcates that the expllcltness 
of a curriculum or Inservlce content has an effect on its implementation. 
Hall and Loucks state: "...research and experience have shown that unclear 
expectations are one way to guarantee nonlmplementatlon. Teachers appreciate 
clear objectives— they need to know what they are expected to do ^nd how 
their roles are to change" (p. 16). It is difficult to JLmaglne how a teacher 
can acquire new Instructional skllla unless the skills are clearly 
operatlonall^ed* Thus, one criterion of an effective inservlce program is 
likely to be the extent to which its content is clearly operatlonalleed. A 



characteristic of the four tnservlce' experiments Is that the teaching skills 
•re stated at a relatively low Inference level and are easily observable In a 
model teacher's performance. In contrast » Ogletree and Allen (1974) found ♦ 
that a majority of. thelt- sample «)f elementary teachers believed that the 
.objectives of^h^lr "Inservlce meetings" were not clea^t^def^ji^. 



3. Complexity 

The complexity of a new curriculum or Inservlce program has an effect 
on Its Implementation. The conplexity of teacher qbjectlves In an Inservlce 
, program is probably a function of several factors: number of skills to be 
learned/ whether the skills already exist to s<m6 di^gree In the teacher's 
repertoire, and the extenjt to which the skl^s must be adapted to classroom 
conditions. Hall and Loucks (1980) stated that, "When the Innovation is 
complex^... ma joj components should be phased in one or a f tfW at a time" (p. 
18). Gersten, CamineV and Williams (1981) found that teachers in their 
s^ple needed to learn the skilly of a conplot direct instruction model in 
phases— tseveral skills in each phase— over a relatively long period of time* 
These results suggest that if complex teacher objectives are- delivered to 
teachera in just- a few sessions., the inservlce activity will have little 
effect on their instructional behavior, and subsequently little effect on 
.atudents' basic skill achievement. 



A. Expected Leve# Of Performance , „ 

In skills-based inservlce programs teachjsrs are expected to iticrease j 
or decrease their use of particular Inst rue tiotiaJL behaviors. The direction,, 
^ but not the degree of change is specified in most of these programs. An 
"interesting feature of the inservlce* programs In the fout bas.ic skills . 
experimeh^s is that specific levels of use of some instructional behaviors 
are specified. For example, one of the recommendations in Crawford's program 
is, "Teachers should avoid calling on volunteers more than 10 or 15 percent 
of the time during quest ion-and-answer sessions" (Crawford ^t al^ 1978, 
Appendi* A,* p. 4). In the program developed by Goo^ and Grouws (1979) one of 
the recommendations is to spend the first twenty minutes of a Monday math 
period conducting a review of skills and concepts covered during the previous 
week. 

This dimension of inservlce teacher objectives Is related to the 
second dimension (operatlonalisation) . Operationalization refers to the » 
explidtness of the teacher objectives. Expected level of performance refers 
to specificity of criteria for determining whether the objectives have been 
met. » 

. , B. Student Objectives 

We assume that inservlce activities have objectives at two levels. 
The Immediate objective is to b^ing about an increase In teacher competence. 
The longer-range objective I9 to bring about Imp-rovements in student, 
^^ierformanc^ as . a result of the Increase in teacher competence. ' - 
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In this sectldn we discuss dimensions related to these longer-t^rm 
objectives of Inservlce education, namely. Improvements In student 
performance. We are aware that the connections between Improved teacher 
competence and ^Improved student performance are Complex. The connections may 
be explicit and experimentally validated, as Is the case with the training 
programs used In the four inservlce experiments. We suspect, though, that In 
many Inservlce activities the connections between teacher objectives and 
student performance gains are vague and unverified. Welck (1976) and, others 
have commented on the prevalence of "loose coupling" In school ^^ganlzations. 
One manifestation of loose coupling Is that means, such ar^lnservlce 
activities, are often disconnected from end s^ such as Improvement of student 
performance In the basic skills. 



5. Target Objectives. 

- ■ 

Public criticism of the schools In recent years has focused on the 
failure of many students to acquire basic skills In reading and mathematics. 
Educators are well aware of this xrltlciam. For example, a recent report on 
the status of professional development in Oregon (Schalock 1977) Included the 
statement that, "There... is an Increasing demand for schools in X)regon, as 
there is throughout the nation, to provide better preparation in the basic 
skills of reading, writing, and computation" (p. 1). We might expect, then, 
a high proportion of inservlce activities concerned with basic skill 
objectives. However^'^he only study that we could locate with pertinent data 
found just the opposite to be true. This study (Sullivan 1981), which we 
cited earlier in the report, found that only 10 percent of the. New York City 
inservice programs were related to reading and mathematics instxuction. 

Research on teacher preferences and values suggests that basic skills 
development would not be a high inservice priority for teachers. Schurr and 
his colleagues (1980) found that teachers prefer Inservice topics that 
concern student motivation and attitudes. Recent studies by Prowat and 
Andei^on (1981) found that elementary teachers consider their most Important 
task tq> be attending to stu4ents': affective needs^XAlsp, when asked about « ^ 
their priorities , "teachers made twice as many Stetemp nts about things they 
did to promote affective growth (for example, getting students to Interact 
positively or feel good about themselves) as compared to cognitive growth" 
(p. 1). Similarly, a study conducted by Harootuhian and Yar^er (1981) found 
that mp^t teachers judge their success by the degree to which they, involve 
their students affectively in instruction. These results suggest that, given 
*the choice, teachers would opt for Inservlce objectives having an affective 
theme rather ^Ihan inservlce objectives relating to basic skills instruction. 

Target objectives for students is a very important dimension of 
Inservice "education. Cawelti (J981) observed that support for Inservice 
education ultimately rests on its demonstrated connection to "objective 
productivity criteria," such a^ basic skills achievement. Critics of the 
federally funded Teacher Centers claimed thatf such tenters should not be 
supported because they served the needs of teachers rather than the n^eds of 
students. 

Some Inservlce progrjfias may seek to train teachers with the ' 

• * . ■ .',.«>.' 
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expectation that change % teacher, competence will produce direct changes^. In 
stiident perfornuincel There may be an additional expectation that these 
changes In ^tudfent performance will lead to other changes In students either 
•concurrently (6lde-ef f ects) or over a longer period of time. For example, 
some 'educators believe If^ student self-concept Is Improved, there will be 
subsequent Improvements .In student academlb achievement. Many dnservlce 
^►programs ard designed to help" teachers acquire skills tfor reducing student 
discipline problems, In the classroom. It Is conceivable that reduction of 
• stiident discipline problems will lead Immediately to more instructional time 
on task (a side-effect). In, turn, Increased time on task may result 
graduay.y In Incrieased academic achievement. ^ 

O ' f 



6. Expected Level of Achievement 



The effectiveness of the Inser^lce programs used In the four 
experiments was assessed by examining pre/post g^ins of the "experimental 
group and by comparing adjusted ^post-test scores of the experimental and . 
control groups." Statistical significance was the criterion of whether a ^ 
noteworthy effect occurred. , Jn regular school practice, thbugh, educators 
may be unwilling to sponsor inservlce programs juqt to produce a 
statistically significant gain in students' a^hievemenf scores. 



Ther^ is ample research evidence (e.g., Brophy and Good 1974) that 
educators have expectations about individual students' achievement potential. 
We know little, though, about the relationship between educators' 
expectatit>ns for student achievement and educators support for inservlce 
(xrograms as a response to..thes€^, expectations." It may be that decline in t^st 
scores over time within a scho6l district is a more effective trigger for ^ 
initiating a basic- skills program tlian is the perception that; students are 
performing below expectations. In fafit, there is some reasoo to believe that 
educators adjust d^ectatlonp to match the realities of student achievement. 
For example, the California legislature in 1976 enacted minimal competency 
requirements ^f or hi^h school graduation, but allowed each district to make up 
£ts own test and set its own standards. Savage (1982) reported that, "Jewer 
than 1 percent of high school students were denied a diploma because of the 



C. Delivery System > 

^' " . ■ ' ' 

The delivery system in inservlce education refers to the process used 
to achieve teachet-level objectives (i.e., gains in teachers'- knowledge, 
, attitudes, and 'skills). Traditional delivery systems in inservlce programs 
" I include presentations by experts during school districts' ••ins'e'^yice ^^7^"; 

university coursework, which^ typically is in a lecture demonstration 
discussion format; and hands-on workshops. Another characteristic of » 
traditional inservlce delivery systems is that they are relatively brief, 
"one-shot" experiences. By contyatt,'^ educators ar^ Increasingly advocating* 
multi-stagd, lengthy delivery systems that include both training and 
implementation strategies. For example, Pankrat* and Martray ,(1981) rfecentlyn 
focpttlated an eight-stage insetvice/school improvement model that includes 
awareness building, sklll-t raining ,ylmplementat ion a8|8lstanj:e, 'rfnd monitoring 
and maintenance. In this section we rev^w evince that supports the' 

o " .... / . ' • • ; ' , 
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eff ectivenctss of these conponents of an Inservl'ce delivery system. 

1 . I^eadlness Activities ^ ^ 

We usi the term "readliiess activities" to refer to the Inaervlce 
experiences provided to teachera^and administrators prlot 'to the 
sklll--tralnln^^'phase of an litdervlce delivery system. There Is a small 
amount of evidence t ha thread Iness activities have an Important effect on how 
well Inservlce training and related school ^Improvements are Implemented 
(Loucks and Pratt 1979) • * " 

The llteraturje on Inservlce education suggests several activities 
that should be Included In the readiness phase of an lifservlce delivery 
system. Pankratz and Martray (1981) claim that these activities are helpful; 
develop awareness of need among formal and Informal school leaders; obtain 
f their agreement oh a delivery sfstem; and use exploratory workshops to 
provide Information and to deyelopr consensus. ' . 

nlller jp981) argued that an Important component of an effective 
school Improvement process Is teachers^ acceptance of their personal 
responsibilities for students^ basic skill achlevment. Miller "^s claim Is 
supported by Berman and HcLaughlln^s finding (1978) that teachers' belief 
about whether they 6%uld help students Was correlated with Uie degree of new 
.program Implementation.^ Readiness activities might be coi^mted to help 
teachers raise their expectations of students and Improve melr attitudes 
^oward their own Instructional efficacy. , . 

The concerns-based Approach to curriculum change developed by Loucks 
.and Pratt (1979) suggests several' readiness activities that* lolght be 
Incorporated Into an Inservlce^dellvery system. Loucks and Pratt found that 
teachers have three "concerns" prior to becoming Involved In Inaervlce 
training dnd curriculum Implementatj^: absence of concern, concern to know 
more about the new pro-am, and concerp about how Its use wllj personally 
^ .^fect each of them. Loucks and Pratt described a '^re^-lnserylce" session 
^kt <hey developed to help teachers deal with the first two concerns In a 
particular^ cutrl^ulum Implementation project. 



8. Instructional Process » 

InstructloncM process te^ers to the methods used by inservlce staff 
to tra^ln teachers In knowll&dge and skills or to Modify their attitudes. 
Table 2 ^umm^rlzes the methods used In the'.^our Inservlce 0cperlnent8 and the 
ongoing studies by Helms and by 'Eutchlns^ ' ^ i 

'Examining commonalities In four completed studies, we "find that each 
of th^ Inservlce programs Inyolved at leaSt two .meetings. (The "minimal" 
group In Crawforjd'a stucfy did not Include any meetings, with resulting Lower 
end^of-year achleveioentA scopes relative* to thp "maximal" group^i^ Another 
coMoii feature across tffe studies Is the use of brief manuals to ded^cribe the 
desired behaviors* 
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TABLE 2 

Instructional Process Used in Basic Skills Inservlce Programs. 
!• Andersoni Everjtson,' and qyophy (1979) * 

project staff met with teachers to discuss' the study. * Teachers then read 
a 33-page manual describing '22 research-validated principle! .of reading 
group Instruction, Jind; took a shorts cyilz on It. Teachers melTonce again 
with project jBtaff to discuss fhe annual. One subgroup of these*' teachers 
was observed for the^r implementation of the principles throughout the 
school year« Another subgroup was not observed* (The two^ttalned groups 
d 14 not differ from each other In end-of-year student achievement •} 

' m 

2. Crawfdrd et al. 1978 



The "minimal" training group received a training manual and one 
self-admlnlstered test per. week for five weeks. The "maxlmiil" group 
received the same manuals and tests, and also came to a two-^hour meeting*^ 
with project staff each week.. In these meetings the teachers i^lscussed/ 
practiced, and stddlM the techniques; engaged In role-playtng exercises; 
and viewed videotapes of a "model" teacher performing the behaviors. 
(End-of-y^ar -student achievement was somewhat higher for "maximal" 
group.) 



3.. Helms (described in Rouk 1981) <^ 

j» 

Teachers follow A. five-step process: 

(a)^^ teachern collect data on their students' achievement and on 
* their -own classroom procedure;?. * ' 

*(b) teachers c^mpar^ their data with' data of high-achieving classrooms. 

(c) teachers select ways to modify their Instrui^tlon to conform to 
conditions ^found in high-achieving classrooms. 

(d) jteachers Implement thelt modifications^ 

(e) teachers repeat steps (a) and (b) to determine progress. 

r* • ^ 

/ 4.- Hutchins (described in Sally 1981) 

Four ^ne-day wprkshop>s Spread over a period of several months. Each 
work8h6p •covers" research-validated instructional principles. Between 
workshops ' teachers ^carry. out "homework" assignments involving classroom 
observation and feedback. ^ 

5. Good and Grouws (1979) 

Teachers atteiid .an latVpductory 90-^mlnute iteetlng and then read a 45-page 
^ manual of research-validated principles of mathematics lilstructlon. Two 
weeks ^later teachers attend another 90-Alnute meeting In which project 
staff respond to thelt^ questions and concerns. 

6; Stalllngs (1980) ' ^ 

Each teacher is observed for three days, then given a quantitative 
sumary of the observations as f eedbapk to help change his/her 
Instruction to conform to' research-validated specif Icationi. Teachers 

also attend four two-hour-workshops over a two-and-one-half month period. 

* • • • . ' • ♦ * 
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Teacher behavior was observed and crrltljqued In two of the studies. 
Stalllngs' teachers were observed In their classrooms and given both a 
qualitative and ^quantitative summary of the results. Crawford's ''maximal** 
group- teachers were observed In role-playing exercises during meetlngs.\_^ 
(Teacher behavior was observed In one of Anderson's trainee^ groups, but the 
observatldns were not shared with the teachers.) Classroom observation and 
jEeedb^ck are b^lng Incorporated In the Inservlce programs currently beln^ ' 
evaluated by Helms and by Hutchlns. Lawrence and HariTlson (W80) found In 
their :meta-analysls that successful Inservlce programs tend .to Include a 
sequence In wTilch participants' can try out new behaviors In- their classrooms 
(or In simulations) and then receive feedback from a i skilled- person. 

It appears that extensive skllla tralnln'g of the type used In ^ 
mlcroteach^ng programs (^.g. , Borg et al. 1969) Is'^ not necessary in a basic 
skills inservfce program* The critical elements appear to be (a) the 
> opportunity to study manuals that present research-validated pi:lnclple& of 
Instruction, and (b) ,the opportunity tp, discuss these principles In meetings 
with an Inservlce trainer and other teachers at the same grade level. The^ 
value of supplementing the^e process elements with classroom observation and 
feedback has not yet be^n cleatly established'. 

The results of this research suggest that teacher productivity. In ' 
baslt skills instruction can be increased by using a relatively, simple 
^:(ristructlonal process. It should be noted, though, that these studies 
^tended over a period of.rTo more than a single school year. Also, the 
Ihservice programs were not successful for all^teachers. Instructional 
processes not used in the four inservlce experiments may produce more 
sustained effects, and effects for more teachers, than those observed in the 
experiments. For example, 'the coaching procedure descrl^bed by Joyce and ' 
Showers (19^2) may significantly enhance the effectiveness of training 
manuals and meetings by promoting transfer of the Instructional principles to 
the teacher. trainee's particular classrobm situation. 

•i 

We could locate vnoodata on the frequency with which the instructional 
process described above (manuals and meetings focused on research-valldnted 
Instructional principles) occurs in practice. A survey of 1,200 South Dakota 
teachers (Betz, Jensen, and Zlgarni 1978) found that they had engaged 'in 
these types of inservlce activities: reading of bulletins, newsletters^ and 
6ther printed matter (BO percent of sample); Inserx^ce meetings (48-61 
percent of sample, depending upon type of meeting); one-day workshops (48 
percent of sample); and observation of other tedchers (20*^23 percent of 
sample, depending upon type of observation). It is unlikely that the 
objectives of these activities; were fflmlltfr to those of the objectives in the 
four inservlce experiments. Reports of the correlational research on whieh 
the four inservlce experiments were based ,^and the experiments themse].ve8, 
had npt been widely disseminated ^t the time of Betz' s survey. 

/The inlservice instructional processes that were frequently recorded , 
in the survey (reading, meetings,* observation) were the same as tho8e>used in 
t)ie four' inservlce experiments. Thus, it appears that an instructional 
process is already In place (assuming that the South Dakota data are 
general^zable across states and across time) for incorporating the Inservlce 
programs used in the four experiments. ^ • 



9. Maintenance an4 Monitoring , * 

• * 

Maintenance refers to the use of follow-up Inservlce activities to 
help teachers preserve or Increase gains made In initial training. ^ 
Monitoring refers to the» use of prpcedures for making continuing observations 
of teacherfe' adherence to d^sir^d Instructional strategies or of student 
performance. 

There Is' evidence that changes In teacher be^iavlor as a result df 
training tend to revert to baseline J-evels over longe? periods of time than 
those observed In the four Inservlce experiments. Johnson and Sloat (1981) 
found reversions bf 'teacher beKkvlor to baseline rate twelve months after 
completion of training. . Borg (1973) found reversions three years after 
training. It appears, then, that monitoring and maintenance procedures are 
desirable In order to preserve teacher productivity gains over a period of 
school years. ' ^ ' ^ 

• An^ Important element of the four Inservlce experiments Is that the. 
project staff maintained contact with the teachers over a dui;atlon of months 
by spacing training sessions and by collecting. classroom data on teacher * 
behavior and student performance (achievement testing). The continued 
observations' are like a monitoring procedure and may have had the effect of 
culug teachers to reinstate ^desirable Instructional, behaviors. 

. A maintenance Intervention was used In the Crawford experiment 
several months after the Initial five-week training period. Both the 
"maximal" and "minimal" groups received a "refresher" training manual. In 
addition, the teachers In the maximal group were videotaped and given 
feedback on their Implementation of the Instructional principles. These 
maintenance Interventions were not [experimentally manipulated (present versus 
absent) to determine thfelr effect <|n teacher and student performance. 

One of thjB conclusions reached by Fullan and Potiifret (1977) In their 
review of research was that "Intensive in-rfervljce training (as distinct from 
single workshops or pre-servlce tr^^nlng) Is an* Important strategy for ' 
Implementation" (p. 37). This particular conclusion was based primarily on 
the Rand. studies of educational change (Berman and McLaughlin 1978). It 
seems reasonable that "one shot" Inservlce education will have less effect on 
teacher productivity than ^ntlnuous Inservlce education that Includes 
monitoring and maintenance processes. 

Maintenance and moh^torlng activities do not appjsar to be features of 
current Inservlce practice. Less than. 20 percent of the teachers In the^ 
survey conducted by Betz and ftls colleagues (jl978) reported that their 
Inservlce meetings -Included follow-up ^activities. In an earlier survey ; 
Ogietree and Allen (197A) found ttiat a maijorltyeof urban elementary teachers 
reported ho follow-up dr evaluation of their Inservlce meetings^ 



10. Training Site ' ^ ' , 

A . c 

We cpuld locate ho Empirical data concerning teachers' preferenceis 

for training slties. The*' teacher's own classroom was used as a "training" 



sit^ In the four Inservlce ex per lure nts In that each teacher's classroom, 
behavior was observed In order to assess Implementation of the desired 
^Instructional behaviors. In Stalllngs study these observational data were 
also used a$ jiersonal feedbapk to the participating teachers. / 

The meta-analysis conducted, by Lawrence and Harrlsoi\ (1980) fbund 
''that inservlce programs tended to be more effective If conducted at the 
school site. This generalization, however^ applies only to Inservlce 
programs that emphasized affective or skill performance objectives. 



11. Trainers - ; 

Each of the four Insfervlce experiments required one or more Inservlce 
trainers .4 Their roles generally did not require cldse, sustained Involvement 
with the teachers. It Is not known whether Itidlvldual differences between 
Inservlce trainers would Influence the ef ftsctlveness of the Inservlce^ 
programs used In these experiments. • 

The teachers surveyed by Betz, Jensen^- and Zlgarnl (1978) reported 
that they learned the most from other teachers. However, their ratings of 
college and university personnel and professional consultants were nearly as 
high. McDonald (1980) reviewed a series of British experiments on teacher 
Induction programs, and concluded that the most successful oneQ were those 
that made available to the beginning teacher an experienced teacher who. could 
serve as a monitor, model, and counselor. McDonald raised the question*, 
whether it was necessary for an experienced teacher to perform these roles, 
or whether others — such as a principal or university supervisor~could 
perform them. " ^ 
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12. Scheduling < 

We see at least three issues related to the scheduling of inservlce 
activities: time of day or week for holding an inservlce session, spacing of 
inservlce sessions over time, and' the time frame over which a particular 
inservlce program is implemented. 

With respect to the first issue, Betz and his colleagues (1978) found 
that the teachers in their sample generally preferred inservlce education to 
be scheduled during school hours. In practice, though, over one-half of the 
sample reported attending some inservlce activities beforehand after school; 
one-fourth of the sample repotted attending, weekend inservlce activities. 
The inservlce activities in the four inservlce experiments could be held at 
any time of day or week, except for the colleetion of classroom observation 
data and student achievement tests. \ 

The results of Lawrence and Harrison's meta-»analy8is (1980) do not 
support the teacher preferences expressed in Betz's study. They found that 
effective inseryice programs tended to be scheduled at times (evenings, 
sumisers) that did not compete with other professional obligations of 
teachers. Inservlce programs scheduled during work hours were considerably 
less successful in achieving objectives. ^. ^ 

« 



Sessions of a typical Inservlce program can be held all together 
(e.g., an l-ntensive weekend .workshop) or spaced Qver a longer period of time. 
We could locate no research* findings concerning teacherct' preference for 
"massed" or spaced sessions. A possible- advantage of spacing inservice 
sessions is that they provide sustained contact between teachets and 
trainers, allow; for spaced practice of new. skills, and allow more time for 
teacher concerns to surface and be addressed. 

The third' scheduling issue is the time frame over which a particular 
inservlce program is to be -implemented. Loucks and Pratt (1979) emphasized 
the need. for a .^ylibstantial time period: "...research indicates that three to 
five years are Necessary to implement an innovation that is significantly 
different from current practice" (p. 213). Fullan and Pomfret (1977) also 
concluded that implementation of innovations, with concurrent inservice 
support, required a long-term perspective. 

The four inservice experiments produced effects on student 
achievement over much shorter time. frames thap those recommended by the 
currfCulum Implementation researchers mentioned above. Good and Grouws' 
experiment il979) extended over a four-naonth period. Training occured in the 
first two .weekd^> The experiment by Anderson, Eyettson, ^nd Brophy (1979) 
extendedi over*^ a school year, but training involved Just a few hours of the 
teacher's time at the beginning of the school year.. The experiment by 
Stallings (1980) yi^lso extended over a school year, with training spaced over 
a period of approximately one dionth before and after the Christmas holidays. 
The experiment by Crawford and colleagues (1978) extended over a school ycar^ 
too. Training occured over a six-week period in early November, and there 
was a refresher session several months later. 

The discrepancy between the time frames in these experiments and 
thode r^ecommended by curriculum implementation researchers may.re^flect 
dlf f erence^pf purpose^ The primary purpose of the experimei^« was to 
demonstrate the effects of inservice training on student achievement. By ' 
contrast, curriculum Implementers are concerned with the institutionalization 
of an innovation as part of a school improvement effort.' This purpose may 
well require a longer time frame in order to accommodateT^'adiness 
experiences, gradual training of all staff, and monitoring!) and maintenahce of 
training effects. ^ . ' \ 



Organizational Context 

Inservice education is fundamentally a learning experience that 
occurs for lndivldua3> teaohers. It is also the case tha^t teachers are 
members of school organizations. Characteristics of these olrganlz^ions may 
well influence the delivery of inservice education programs to teachers^^ 
These same characteristics may also influence the effects of the program on^ ^ 
teacher^ and their students^ We consider in this section three 
characteristics of school organizations tHat are likely to influence 
* inservice program effectiveness* 



13. Purpose for Pagtlclpatlon 

^ ^ • . 

This dlnenalon was suggested by Joyce's discussion (Joyce, Howey, and 
Yarger 1976) of the **modal system** In Inservlce education. The podal system 
refers to the organizational context In which Inservlce education occurs, 
Five such contexts were distinguished by Jo^ce and his colleagues: 

1^ Job-embedded mode, e,g«, school coomlttei^ work. * \ ^ 

1. Job-*related mode, .e.g^i school di^i^rlct workshops Wslde of regular 
tschool hours • 

a 

Credential-oriented mode, e.g., university certification courses. 



Professional 'organization-related work<, e.g., NEA workshops. 

O ■ • • . - . ■ • • • 



5. Self-directed mode, e.g., sabbatical leaves. - 

We prefer to think of these modes as representing different purposes for 
Inservlce education. We distinguish four* such purposes: 

1. Inservlce for personal professional development, which corresponds to the 
self-directed mode and pei^haps the professional orgaiftzatlon mode. 

• . * " 

2. Inservlce for credentlalllng, which corresponds to the 
credential-oriented mode. ' " 

3. Inservlce for the purpose of being Inducted Into the profession. 
McDonald (1980) has argued that first year teachers need a spWlal form 
of Inservlce ed;|^atlon (called "Induction") to help thfem adjust to 
full-time teaching and to le^rn skills not covered In pteservlce 
education.^ . ' . ' 

4. Inservlce for school Improvement, :kMch typically would be done In the 
Job-embedded and Job-related mode^. 

^ The first thf^e purposes telat^ to the development of the Individual ; 
teacher. Inservlce for school Improvement, though » gives priority to the 
•school organization* .teachers' personal needs ntay be taken Into account, but 
teachers^ roles as members of the school organization 'are critical to this " 
form of inservlce education. Campbell (1981) developed two separate models 
of Inservlce education based on this distinction between ne^ds of the school 
system and needs of the Individual teacher. Millet and Wolf <1979) developed 
a c5rclical Staff Deveiopment/School Change model reflecting these two 
purposes of teacher education. 

Each of the four Inservlce experiments was focused on the Individual 
teacher and his or her classroom. Teachers volunteered for the Inservlce 
program. They were not recruited because they were members of a particular 
jSch<>ql_sta£JE^^ — Als<^r-tjie"^uildij5g "principals and district curriculum 
.specialists were not directly involved in the program^ as they might have 
been if the program had been conducted for the purple 6f school inprovenient. 

Hutchins (described in Sally 1981) is currently testing Kasic (skills 
Inservlce programs for the purpose of sc^gool improvement. The program covers 



ERLC 



21 ' 



ERIC 



content •Imilar to that In the four Inservlce experiments, ^but there are ^ 
•everaL Important contextual differences. The most critical difference Is In 
who receives the training: "The workshop series i$ generally conducted for a 
school district or group of schools within a district. Each participating 
school sends to the workshop a team of the principal and two or three 
teachers; a central office staff member Is also Involved" (p« 11)« The 
workshops also cover training In standardized achievement testing In order to 
help educators increase tea4: validity In their district. Hutchlns notes, c 
however^, that Improirlng test validity Is beyond the capability of Individual 
educators, and therefore requires "distrlct-wlde action.". 

The meta'<»analysls conducted by Lawrence and Harrlspn (1980) found 
that the more effective Inservl^ie programs were designed as a collective 
effort of a school staff. Also, the more effective programs had shared goala 
rather than individual teacher gdals. These results suggest that Inservlce 
for school Improvement Is generally more effective than Inservlce for 
personal professional development. 



}H. Inservlce Cohorts 

The avallflible research Indicates that teac'hers ha^e a strong 
preference for working with other tieachers, ra their than working alone, Un 
their Inservlce activities. Lavrenc^ and his colleague? (1974) concluded 
from their researreh review that Inservlce activities produced more posl-tlye 
effects on.teacher^ when they provide^ mutual ^assistance In ar^lnservlce 
program than when they worked alone. Holly (1982) found In Ker survey of 110 
teachers that they most preferred Inservlce activities that allowed them to 
workn^lth other teachers: "Teachers described their colleagues as valuable 
sources of^practlcal Ideas and>lnformatlon»:.iielpful advisors on professional 
,p<roblems, the most useful evaluators of teaching skills, and undetstandlng 
allies" (p. 418). Similarly, Ngalyaye and Hanley (1979) found In tihelr 
survey of 228 teachers that ^the teachers preferred Inservlce meetings 
prrganlzed for colleagues with slmllctr teaching responsibilities. 

We consider it worthwhile to distinguish at least three aspects of 
^ how toachers are groupejd for an Inservlce activity: Individually-based 
versus group-based Instruction; groups that are. homogeneous or heterogeneous 
with respect to teaching .responsibilities; and whether the group Includes 
same-school or dlf ferentwschool colleagues. We tould. locate no evidence 
relating to the dlf ferentl^JL effectiveness of variations In these Inservlce 
cohort factors. The four Inservlce experiments used a combination of 
Individual 1^-based Instruction (study of manuals) and group^based Instruction 
(Inservlce meetings). Also,, each study. Included teachers at the same grade, 
level. This feature of Inservlce group composition may be particularly s 
^ relevant because It helps to Increase the relevance of the Inservlce activity 
to ea<!h teacher's situation (see dimension 25). 



15. Concurrent Organizational Changes 



As indicated above, one niajor purpose of Inservlce education is to 
bring about school improvement. If ' an inservlce aictivlty is used for this 
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purpose /It would be informative to learn whether the activity is supported 
by other changes in the school system of which the teacher is a member. 

The building principal is probably the most influential symbol of 
. sthool organization for teachets. Loucks and Pratt (1979) concluded from 
their research that, . .what the. principal does is critical to the success, 
of an implementation effort" (p. 215). These critical role behaviors of the 
principal have been referred- to as "instructional leadership" (Rouk 1981). 
Leithwood and Montgomei^y (1982) recently reviewed the research on the role of 
the principal in schoc^l improvement. These reviewers found that the more 
effective principals were more likely to participate in teachers' inservice 
acttvitl^es. Participation included attending all or at least the early 
inservice sessions provided for^te^chers. 

^ . "'^ • 

Another type of o^rganizational change relevant to inservice education 
is curriculum revision. Inservice education is sometimes used to support 
implementation of a new curriculum. In turn, the new curriculum may include 
- features that facilitate the teacher and student o'^bjectives of the inservice 
program. Examples of such features are: teacher pianuals that contain lesson 
plans basQd on direct instruction principles; criterion-referenced tests; and 
learning activities that injure high student success .rate. We could locate 
no research concerning whether inservice is more or less effective when it 

accompanies curriculum revision. 

t ? . ■ / * 



16. Other Inservice Activities 

The effects of a particular inservice program are possibly dependent 
on other inservice programs that the teacher experiences either concurrently 
or at some other point in time.^^^T^ese^ojm^ may reinforce and build 

upon the objectives of a^ particular program. AnoCher-poaaibility is that 
other programs neutralize the impact of a particular /i)rogram^y4if fusing the 
teacher's attention across disconnected prioritjc^ goals. 

Researph is uninf ormative about how teachers' inservice experiences 
articulate with each othei; across a specified period of time* A few studies, 
however, have addressed the related question of quantity of inservice that 
teachers recetve. Arends (1982) followed' beginning high school teachers over 
a three yeal^ period* His sample participated in a mean number of 10.5 
inservice activities during this interval* This is an average of ^.5 
activities per year* The mean total number of inservice hours for the sample 
was 291 hours, or 97 hours per year. In contrast, Schalock (1977) surveyed 
450 teachets *and found that they engaged in a mean number of 1*5 activities, 
oyer, the course of a year. 

Two differences ia the method^ of Arends' study and Schalock's study 
may explain their disparate estimates of inservice quantity* Arends used * 
interviews and only studied beginning teachers* Schalock used questionnaires 
and studied teachers representing a much wider range of teaching experience. 

\ An Interesting finding of ^Arends' study was a correlation of .67 

w between (a) principals^ ratings of a teacher's competence at the end of the 

\ ^ teacher's first inservice ^ear and.(b) the j:eacher's total number of 

f inservice hours over the three ytear period. This finding may mean thap 



participation In many Ins^rvlce actlvltl^s^ leads to Improved teacher 
effectiveness. An equally plaudlble Interpretation Is that a teacher's high 
Involvement In Inservlce Is seen by the pr4.nclpal as a sign of competence. 

: E. Governance 

Governance Involves a number of policy and management decisions that 
may influence the effects of 4ndervl6e education ob teachers and thelc 
students. Governance Issues have been at the forefront of dliilogue on^ 
Inservlce education In recent years. For example, the f ederally-*funded 
Teacher^ Centers were established on the premise that Inservlce education 
would* be more effective If teachers controlled Its design and governance. We 
review In this section the available research concerning various dimensions 
of Inservlce govertiance. The four Inservlce expejlments 'are'not Informative 
about these decisions because the decision to Institute, the experimental 
Inservlce programs reflected researcher Initiatives primarily rather than 
school system^ initiatives. , \ ^ 

.1 . - . • 

• *..«■ ... 

17 • Governance Structures 

This dimension is meant to represent the individual or group that ^has 
responsibility for niaking key inservlce policy decisions concerning: 
selection of inservlce objectives and activities, design of the activities, 
incentives and sanctions, and allocation of resources, teacher Centets and 
some school districts have governing boards to make these decisions. In 
other settings these decisions may be left to the ^ulldln^ principal or 
district staff development specialist. 

Inservlce activities may be associated' with several levels of 
governance. For example, an office of a state department of, education may 
make the decision to mi^^Ate a certain typib of traltiing (e.g. , in 
mains t reaming) at the district level. In turn, a governance board at the 
Sj::hool district level may assume the responsibility for how this training 
will be designed and offere4 to, district teachers. We could identify no 
research on variations in gove'^rnanee stnictutes and whether such variations 
have an influence on the effe^tl^nest of inservlce programs. 



18:.. - Teacher Participation in Governance . ^ 

As might be expeqted, several surveys (Bets, Jensen, and Zlgarnl 
197^; Holly 1981; Schurr et al. 1980) have found that teachers desire input 
into the planning of Inservlce programs. Insiervlce le|iders (e.g^, Gehrke and 
Parker 1981; Johnston and Yeakey 1977) also strongly advocate collaborative 
planning among teacliers and administrators in order to Insure successful 
implementation of an Inservlce program. Three prominent educators (Ryot, 
Shanker, and Sandefur 1979) stated: "Inservlce programs imposed frxm the top 
down are doomed to failure" (p* I'S). Lawrence and Harriion's meta-analysis 
(19B0) found that Inservlce prograsis in which teachers choie at least some of 
the goals and actlvltjles were more effective than entl^rely preplanned . 
programs In Increasing teacher compel^nce. 



19. Recruitment of Participants 



Participation In an Inservlce activity can be voluntary or required. 
There probably are degrees of participation between these two extremes. For 
example, administrator's may stop short of requiring participation, but may 
use strong sanctions ai^' Incentives to. Insure high participation rates. The 
critical element, then, is probably not wHether the inservlce activity is 
voluntary or mandatory, but whether teachers feel coerced into participation 
against their wishes. Even if a par^ular Inservlce r activity is required, 

.teachers may not Te^c% negatively if they wish to participate. . ^ 

* . . » 

i , • 

The four Inservlce experiment's Involved volunteer samples of 
teachers. Voluntary participation seems^ reasonable if the purpose of the 
Inservlce activity is to conduct a fesearcher-controlled exjl^eriment (as in 
the case pf the four experiments) or 'to encourage the professional 
development of individual teachers. When Inservlce education is used for the 
purpose of school Improvement, howeveV, mandatory participation may be more 
effective. School Improvement may require the staff to make their > individual 
preferences and needs secondary to school goals. We could locate no research 
data about the extent to which current Inservlce activities are voluntary or 
required. An interesting finding of Lawrence ^nd Harrison's meta-analysl^ 
(1980), is that mandatory versus voluntary participation of teac^era did not 
predict , inservlce program effecti.veness. ^ 



20. Incentives 

A reasonable hypothesis is that incentive s^ave an influence on 
teachers' willingness to participate in an Inservlce activity and their 
satlsfactloh with the experience. We could locate no empirical tests of the 
hypothesis, howevet^ Some "deiicfrlptiv^ data about inservlce incentives were 
collected in a survey of teachers by Betz and colleagues (1978). Te/achers 
reported that: "The most common and also the most ^ preferred types of 
compiensat ion Included released time, expenses, credit for certificate level, 
and college, credit"' (p. 492:)* ' Approval of thir principal may also function as 
an incentive. The Rand studies (Berman and McLaughlin 1978) found that 
teachers were unlikely to continue impleihenting a new curriculum or method 
without th6 appi^val of the principal. The reports of the fonir inservlce 
experiments do not sjpedfy t&hat type'$ of incentive, if any, were given to 
teachers for participating^ in the Inservlce programs. ^ 



21. Sanctions 

In the discussion of pairtlcipant recruitment (dimension 19), 
referencei was made to the possible use of coercion to secure teachers^ 
participation in an inser^^ce activity. The dimension of sai^ctlons refers to 
the use of threatened ne|^atlve consequences to secure teachers' agreement to 
participate iC^an dnservicfs activity, or to punish them .for 
noii-pattlclpatlton. An example of suQh a tactic is to require "remedial'.' 

25 3S ' 



supervision as a condition of continued employment In a school dlstf^t* ' 
Another example Is non-renewal of a teacher-iceirtlflcdte If a teacher ^oes not 
earn a minimum number of credits within a time l,lmit« No research about use 
of sanctions In Inservlce programs could be located. ' 



22> Costs V 

There Is surprisingly llt.tle Information In the literature about the 
costs of particular Inservlce programs* A survey of Oregon school districts 
several, years ago (Schalock, 1977) lound that typically 3 to 5 percent of 
district budgets was allocated to inservlce educatlon« It la not known how 
^ much teachers pay on their own for inservlce programs^ and whether such 

expenses affect how' much they benefit from the programs. 

' . F« Selection and Evaluation 

The evaluation qf inservlce programs is not a well-rdeveloped field* 
^ Lawrence and Harrison (1980) stated that their meta^-'analysis of , the Inservlce 
" literature began with a review of approoclkately 6»600 abstracts and 
references. Only ISO of these documents reported quantitative dat^ and onl^ 
59 of them contained sufficient datt for inclusion in the meta^-analypis. 

* 

The Lawrence and Harrison Sieta-analysis suggests that systematic 
evaluation of inservlce programs' is the exception rather than the rule. 
Also, there have been few efforts to conceptualise the paraimeters and 
purposes of inservlce evaluation. One of these efforts was a % 
conceptualization of the -levels of impact that laight ^result from ati Inservlce 
program (Gall et al. 1976>. Four levels of Impact were distinguished: 

Level I - Implementing the t^ervice program. This level of Impact refers to 
how well the program is^Knducted. A possible Indicator pf level I 
Impact » for example / Is, the number of teachers who choose to participate 
in the program and complete it^ ^ 

Level II - Teacher ^provement. This type of Impact refers to the effects of 
the inservlce program on teacher competence. ' 

Level III * jChange in student behavior^ Many Inservlce programs have the 
goal of changing sttl^ent behavior by first changing teacher behavior 
(level II). 

Level XV - Changes In the environment. Level II and III effects of a program 
might spread to o^her contexts. For example, a teacher who learns about 
a new instructional practice in. an Inservlce program might Informally 
teach it to his or her colleagues. 

Each of these levels of Impact can be the objec^ of evaluation. We 
have included 'Levels, II and III as dimensions below (nos. 26 and 27) because 
they are the most direct outcomes of Inservlce programs. We have also 
included several dimensionsr (nos. 23-25) relating to the quality of the 
process by which an Inservlce program is selected or developed for ' 
presentation to teacher s..^ 
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. 23^ Policy ^ . ' 

jf 0 

# This dimension refers to the rationale and evidence that 

decision-makers use to justify th* use of inservic^ activities tfo achieve 
* educational goals. Inservice education is just bne option that can be used 
by. decislon-nnakers to implement policy. For example, if the goal is to 
improve ktudenjts' basic skills. achievement, administrators might considerv « 
these options, among others: reduce class size, hire more teacher aides, or 
issue' directives to teachers to spend more ^tlme on basic skills instruction. 
Idservice education must compete with these optioi^s in the policy*-#aking 
^. process. ' . . 

k decision-maker's rationale for selecting the t^pe of inservice 
activities used in the four inservic^, experiments probably would be that such 
activities are of demonstrated effectiveness in improving student 
• 'achievement. There is evidence, though, that decision-makers may no?? be 
« receptive to such research data on inservice effe'ctiveness. Schalock (1977) 
found widespread concern among Oregon educ^ors about the effectiveness of 
inservice educatl^on as a method of improving educational practice. The 
problem is compounded by the fact that, at leasts in some ^ejftings, staff 
V development Specialists are only "loosely coupled" to policy making*. Vacc«, 
Bamett, and Vacca (1981)'found in their .study that: "No one identifying . 
primarily with staff development claimed to experience intimate involvement , 
in the decision-making process. Staff developers perceive themselves as 
middle managers with limited access and Utt^le power" (p. 51). 

The most noteworthy feature of the four inservice experiments is that 
the teacher objectives are derived directly from correlational research 
linking teacher instructional behaviors to student gains in basic skills 
achievement. This "rational" approach may be the exceptio^ rather than the 
rule. Bermaii ai^ McLaughlin (1978, p. 14), In a study of curriculum 
implementation, found that few school districts in theif sample conducted a 
rational search for better ways to educate students. Similarly |^ Edwards 
(1981) criticised staff development programs for being "a conglomeration of 
activities determined by dfecis^ion making criteria iuch as cost or 
availability or strong advertising" (p. 2). 



24. Needs Assessment 
— — ^ ' 

The training' programs in the four inservice experiments were not 
selected as a result o<*a formal needs assessment process « The purpose^ of 
these studies was to validate through controlled experimentation the ^ 
effectiveness of particular training programs, rather than to respond tp 
identified needs of school districts. In practice, though, school districts 
may initiate Inservice programs for reasons other than demonstrated 
effectiveness. ' * ^ * 

The literature suggests that a formal needs assessment is the procctss 
by which particular inservice objectives become identified and lichieved 
through the implementation of par^ticular inservice activities. 
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NeuiMinn-*Etlenne and Todd (1976) and Powell (1980); for example » have 
described models for developing a comprehensive Inservlce program for a 
school system. Both models rely heavily upoo .such neeas as^ressment 
techniques as site visitations to diagnose system ne^ds^ survey* of |ft:eacher 
concerns^ and survey of teacher pAorities. Similarly » the Montgomery 
County, Maryland school district (Nelson 1981) V^jiltlat^^ Ihserfice program 
to support an instructional renewal, ^roces^'by 41rat ^ndiktlng an assessment 
of training needs for thfe district's teacher». ' ^ 

> We were unable to locate^ any research, hoWever, on the' prevalence of 
formal needs assessments to identify ln§ervic% objectives. It may be that* 
inservlce objectives and activities, are selected by a much more Infoi^al, 
opportunistic process. A particular administrator may initiate an' inservlce 
activity because an inservlce trainer made ^ convincing presentation of its 
merits; because he or she heiMrd about its st^ccess in another district; 
because the school board identified a problem for which an inservlce activity 
seemed an appropifiate solution; or for s^ome other reasori. ' ^ 



25. Relevance of Content ^ . ' 

I — . - . ^ ^ 

Researchers have found that teacheRS generally evaluate^the 
effectiveness of an inservlce program by how relevant its content"* is to ttwlT 
partieuUF' classroom situation. Hol]jr (1982) interviewed idO 1C*-12 teaches^ 
and concluded that, "The singlef most important factor determlningv the value 
teachers placed on an inservlce education activity was its personal 
relevance" (p, 418). Similarly, Vacca and her colleagues (1981) found that 
teachers' major criteria in rating the effectiveness of staff development ^ 
personnel was their relevancy. Teachers pref»K<L staff development 
specialists who gave* them "idisas, strategies, amKiiaterials that relate, 
directly to their own classrooms" (p« 51). It is disappointing, then, that * 
the elementary teachers in one study (Ogletree and Ailen 1974) felt their 
inservlce meetings gehiirally were irrelevant to their professional work. 
Similarly, the. directors of the ISTE (Inservlce Tetcher Education) Concepts 
Ptoject interviewed many teachers and found that "tlie interviewees were much 
less i^pedflc and clear about substance and process fchan any 'other aspect, of 
the structure of ISTE" (Joyce^ Howey, and Yatger^976, p. 23). They reached 
this conclusion: "The Interviews, position jf^pers, ind literature all reveal 
an agreement that much of ISTE contains substance which is irrelevant to the 
needs of classroom teachers"\(p. 23). 

Jhe training provideo^n the four inservlce experiments was pricibiibly 
implemented in part because it was quite relevant to the classroom situations 
of the participating teacheri. The instruhtioiial principles were derived 
from previous correlational researc}i basf d on observations of teachers 
slmila? to thofe who participated- in each experiment. (lA Stallings' " 
experiment [1980], some of the teachers had also participated in the 
correlational study.) Thus, the instructional principles were directly 
relevant to the teachers' classroom situation. H^e teaching <^behavio1^s 
reflected' in thejprinciples were already present to some degree in most 
teachers' repertoires. Inservlce training consisted primarily of having 
teachers do either more or less of 4rHat they already j^ere doing in their, 
classrooms, and , to nequence their activities appropriately. The training .in 
the four experiments was also relevant in that all of the pirtlGlpating 



teach^rji in a jpartlcular experlt^nt were at the same grade level. Tfeus^ a 
question or problem raised by a 'Ut^cher at a training meeting probably would 
be .relevant to tlie other teachers g; too. 



26 1» Measlirement of Teacher Competence 

it major Justification for inservice programs is that thfcy produce 
desfrable changes in teacher competence. Our review of the literature 
revealed that this claim is rarely tested. Evaluation involving objective 
measurement of teacher competence Is seldom Included as a c&mponent 6f 
' Inselrvice programs for teachers « Measurement procedure's can range from 
admlnlst^tion of questionnaires and surveys to observation of teachers' 
classroom' i>ehavi or . 

y ' ■ 

K % 'i ' ^ * • 

Each of the four inservice experiments on basic skills instruction 
InvOiiyed direct observation of the teachers' classroom behavior before and 
after the Inservice program. The observations were focused on teachers' use 
of Instructional behaviors that i^esearchers had found to be. correlated with 
student achievement gains. The purpose of the observational data in each 
experiment was to determine whettter the experimental inservice program^ was 
,more effective than a nort raining condition. 

^ Measurement of gains in teacher competence requites resource * . 

expenditures by the agency sponsoring the inservice progrSflTr ,,We could 
identify no studies that determined whethejf this type of measutement occurs 
in practice and -whet he*r policy' makers find^u till ty in measurement data on 
teacher competence. Also, no studies could be located on the relative 
benefits of collecting teach'er competence data and student achievement data 
for evaluating inservice programs. 
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27. "- Measurement of Student> Objectives. ^ 

^ Educators have available the technology to measure^ most student 
objectives of ^Inservice pro^tams. Whether they choose to measure the . 
objectives, and for what purpose^'are matters of policy. In the f 6ur^ 
inservice experiments, the student objectives were basic skills In reading or 
mathematics. These skills were measured in each"^ study by standardized 
achievement tests. The test data were used to assess the effects of . the 
inservice programs that comprised the experimental treatments 111 these 
studies. Reinstein('(1976) noted other useful purposes that could be served _ 
by sud4i achievement data; determining allocation of resources to alleviate 
weakn^ss in instructional programi ahd assessing whether atudents are 
acquiring "minimum competencies" as tHey progress through school # 

^^^^ f ' 

Although standardized achievement tests are usef ul in. certain 

circumstances, they are also problematic. Sally (1981)| for example, 

referred to a recent study at the Institute for Research on Teaching at 

Michigan State University which found that 30 to 40* percent of items in 

standardized achievement tests are not covered by commercial textbooks at the 

same grade level. Because teachers rely heavily on these textbooks^ to 

determlne>^heir classroom instructional content » there is probal^ly a weak 
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sAtch b€twean vhat teachers teach atid what standardized testa neast^e* Thus, 
the^test resulta aay have low va^dlty for" aeasurlng the objectives of some 
Inservlce prograas. . If teachers attempt to "teach to the test/' they may 
need to deviate substantially from ibhelr £%xtbooks and devote^e^tra effort In 
order to Improve the matcl^ between their Instructional content and the test 
content* This effort may arouse 'resentment In teachers^and resistance 

»to school system eflforts to promote basic skills achievement • 

Another potential problem^, of standardized achievement tests is tHat 
they may be used to evaluate teachers and to make them the 'prime targets of 
accountability for student prog^MS. Edwards (1981), for. example, claimed 
that "apprehenslvenesm^ of teachers about the process of evaluation, their 
distrust of the accountability movement, and their f earfulii^'ss of becoming 
scapegoats foir the failure of Innovations* • Is widespread* 



ry of Inservlce Practi^s 



The effective practices Identified, through the preceding rei£ar(;h 
review of 27 Inservlce dimensions are suimnarlzed *ln Table, 3* The first 
column of trhls table lists 'the dimensions and the headings under which they 
are organized. The next column llstl 'Effective fbservlce practices 
associated with particular dimensions. , In a f^c. cases (for example, 
dimension 11), an effe'ctlve praetl&e , could. not be identified. * 

The third cblumn of Table 3 indicates the type of research from which 

th'e effective practice was 4trl veil* The types of research listed in this « 
column are as follows: 

' # * • ♦ 

1. Basic skills experiments. These are the four inservlce experlmejats by. 
Anderson, Evertson, and Brophy; Crawford et al.; Stal lings; amd Good and 
Grouws. ^" 

O ' ^ * ^ . • 

2. Implementation research. These are studies (mostly descrlptl^Ae and 
correlational in which thi criterion was how well a curriculum or 
instructional method was impldbented In a natural school settings 

3. Inservlce research. These are,us\ially experiments in. which effects of 
different inservlce' practices on teacHer competence (l*e., knowledge, 

^ skill, attitudes) were assessed. 

4. Survey research. These are d^crlptlve studies of teacher preferences 

and attitudes concerning particular inservlce practices. 

' . p * ^ , 

5. ^ Other research. Some studies reljating to teacher expectations, school 
\ principals, ai^d achievement tests are relevant to Several of the 

Insetvlce dimensions. 

In most cases the effective practices listed in Table 3 are a direct 
statement of a finding from one or more research studies. In a few cases the 
effective, practice is a reasonable Inference from {esearch findings. For 
example, the practice associated Vlth dlmensioh'5 is a reasonable Inference 
from the basic skills experiments. Each of these experiments focused oii 
improving student achievement in the basic skills. This focus was dot 
systematically varied within or between experinents. It: seems reasonable 
that inservlce programs focused on this objective would tend to be more , 
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effective la achieving the^ objective thdn Inservlce programs focused on other 
objectives* ^ 

The fiet of research-based^ effective practices ^luuiarlzed ^In Table 3 
provided a standart]^ for coaparlng current inservlce practice* An empirical 
survey of curr^t practices relative to ^thls standard Is reported In the next 
three chaptel?s« 

The effective' Inservlce practices summarized In table 3 are slanted 
toward Improving basic skills Instruction* Most of 'them also apply to other 
InstructloAtU. goals* The few that .are specific to basic skills Instruction 
could t>e mbdlfled so tAat they arcr generic or so that t:hey apply^o other 
Instructional goals** . ^ 



TABLE 3 

Summary of Rese^irch on Effective Inservlce Practices for Improving 

Basic Skills Instruction 



Dimension 



♦'Effective Practice 



Basis 



A« Teacher Objectives 

1« Target Competencies Teachers should use dlrec^ In- 
struction methods 




iperatlonallzatlpn 



Inservlce program should have 
opetatlonally-stated objec- 
tives for teacher behavior. 



Basic skills 
experlkients 

Implementation 
research 



Compl«lty 



Expected level of 
performance 



If the skills to be learned 
are complex , phase' them Into 
the teacher's repertoire 
gradually 

Teachiers should be told speci- 
fically hov much to use parti* 
cular Instructional behaviors 



Implementation 
research; In 
service 
research 

Basic skills. ex- 
periments; Imple- 
mentation research 



B« Student Objective! 
5* Target objectives 



/Expected level of 
achievement 



C* ' Chellvery Syltem 

7« Readiness 

\ * activities 



Instructional 
process 



Inservlce pi03gram should focus 
on Improving student Achieve-' 
' ment In basic skills 



Teachers should be helped to 
believe that students' basic 
skill achievement can be 
Improved. 



Hold meetings that deal with 
teachers' concerns about the 
Inservlce program and that 
build consensus agreement to 
participate In It 

Teachers should study manuals 
de^scrlblng direct Initruc- 
t Ion methods; should discuss 
the methods In group meetings 
with a trainer; and should 
receive observation and . 
feedback on their behavior 



Basic skills 
experiments 



Basic skills ex- 
periments; 
teacher expec*- 
tat Ions research 



Implenentatlon 
research 



Baslc/lkllls 
experiments; 
Inservlce 
research 



TABLE 3 
(Continued) 



Dinenslon 



Effective Practice 



Basis 



9*« Maintenance and 
monitoring 



10« Training site 



Inservice program should main- 
tain, build on» and monitor 
gains made In Initial 
training 

Inservice program should use 
the teacher's classroom as 
training site at least part 
of the time to jprovlde 
observation and feedback 



Implementation 
research 



Basic skills 
experiments; 
Inservice 
research ' 



11« Trainers 
12* Scheduling 



Schedule InsexfVlce sessions 
at times that do not Interfere 
with teachers' other obliga- 
tions • 



D«. Orf^anizational Context 



13. ^ Purpose for 
participation 



14« Inservice cohorts 



15. Concurrent 

organl za t lonal 
changed 



Inservice program should focus 
on school Improvement rather 
than personal professional 
development 

Inservice program should 
provide activities that allow 
teachers to work with and 
learn from each other 

Principal should participate 
in and support the teachers' 
inservice activities 



Inservice 
research « 



Inservice 
research 



Survey 
research 



Implementation 
research; 
research on 
principals' 
behavior 



16. Other inservice 
activities 

Governance Structure 

17* Governance. struc- 
ture 
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TABLE 3 
(Continued) 



Dimension 



Effective Practice 



Basis 



18'. Teacher ..partici- 
pation In 
goveraan'ce 



Teachers should have, oppor- 
tunity to help plan ^he 
Inservlce program 



Suryey research 



19. Recruitment of 
^^tlcipahts 

20. Incentives' 



Participation should be man*- 
daftory In order to bring About 
schoolwide Improvement 

Provide Incentives like vf^ 
leased tlme^ expenses, college 
or district credits, approval 
by school prlndlpal 



21. Sanctions 



22. Costs 



Selection and Evaluation 



Inservlce 
research 



Survey research; 
Implementation 
research ^ 



23. Policy 



Inservlce program should be 
selected because of Its . 
demonstrated effectiveness 
In Improving students' basic 
skills achievement 



^slc skills 
experiments ^ 



24. Needs assessment 



2^5. .Relevance to 
participants 



26 • Measurement of 

teacher competence 



Inservlce program should be ' 
given In schools where dtudents 
have been Identified as low- 
achieving In b^slc skills 

Content of the Inservlce 
program should be relevant 
to the teacher's classroom 
situation 

r - ' 

Teachers' classroc;r. performance 
should be assessed to determine 
teacber Implementation of 
Inservlce content 



Survey research 



27. Measurement of 

sttiident objectives 



Inservlce program effectiveness 
should be assessed by measuring 
student performance on content-* 
valid achievement tests and In 
such a w^y that teachers do not 
feel threatened 



Research on 
achievement 
testing 



CHAPTER 3 
METHOD 



Research Design 

An empirical study was undertaken to answer thPfe five research, 
questions stated In Chapter The iresearch- design was descriptive. One, 
part of the design Involved collectlftg^'data. to describe teachers^ and^ 
^administrators'^ Inservlce actlvltleti and their attitudes^ tCMt^ard the " 
activities* ;It was originally planned that data about the activities would 
be collected lit approKlmately the^ tliie that they occurred* Had this ^ 
occurred, the stuciy would have been planned as a Idns^ltudimll design with 
data collection ex£endlng over at least a school yaar* Hc^iever, the grant 
funding cycle and other factors made it more feasible ^o use a retrospective 
survj^y of the^sample^s inservlce activities. Each educator was asked at the 
ehd of the school year (approximately Jui^e '1982;) £9 recall the inservlce ' 
)|ictivl|^le8 in which he_qr she had participated during th€^ school year and the 
preceding summer* ^ . • • * 1 * ^ ' 

The other part of \ the r^^search design involved a descriptive suxvey 
of the samplers attitudes toward selected aspects of inservlce education for 
improving ^aslc skills instruction* These attlttules were assessed^at one 
point in time. Longitudinal factors (e*g*, changes in attitude over time) 
were not considered In jthis part of the research design* 

Sample 

/ ^ 

Sampling design* The sampling procedure involved selecting three 
school districts and two elementary schools within each district* A central 
office administrator was selected in each district (total N « 3) to repre^sent 
diatrlct-level management of inservlce education. Each principal of the 
participating fi«chools (total N - 6) was selected to, represent school-level 
panagement of inservlce education. Six teachers in each school (total N 
36) were selected to represent participants in Inservlce education. Teacher 
selection in each school was stratified to Include three primary teachers ^ 
(grades 1-3) and three intermediate' teachers .(grades 4-6). The sampling plan 
for one of the three districts is Illustrated "^elow. 



District I 



District Adfiliilstrator 



School 1 



Principal 



School 2 



Principal 



3 Primary 
Teachers 



X Intei^edlate 
teachers 




3 Intermediate 
Teachers * 



This sampling' design has the advantage that it makei possible the 
description of Inservlce actlvi/tlcs Within natural units of organization 
(l«e«» schools and districts)/ AO-so^ the design allows study of differences, 
between districts^ between schoolV^ bietween schools«*<iilthlii*-dlstricts.9 and * 
between teachers* The research results presented In Chapter 4 involve * 
primarily total sample and between--dlstrlct analyses* Supplementary analyses 
involving other differences will be ddne ^t a subse^iuent date* 

Three school districts were recruited to participate in the study* 
The researchers selected the districts to represent a range of community 
characteristics* The first step was to meet with central office 
administrators and principals to secure their approval* lAi^se groups also 
recommended schools that had the most low-achle^ng students in the dl,strict* 
The next "'step was for the researchers to meet with the principal iind teachers 
in each school to recruit their participation* Cooperation wai good* There 
was no need to recruit iiddltlonal school districts because of refusal to * 
participate by one of the initially, approached sites* A modest honorarium 
was paid to each participant in recognition of the time required to complete, 
the interview schedule^* ^ 

School and district characteristics* Characteristics of the school 
districts are summarized^ in' Table A* District I is a mixed socioeconomic 
community with' a prepondje ranee of low^lncome families and some transient 
students* District lit serves some children from low^lncome families^ but 
the community as a whole is mlddle-*class* District II is quite unlike the 
other two districts* It serves a relatively isolated coastal commonitywith^ 



^ . TABLE 4 

ChAtaeterlstlcs of Participating Schools 



• 



Characteristic 


District X 


Dlatrlct II 


District II 




School 
. 1 


School 
1 


School . School 
3 4 


School School 
5 6 


Setting 


Small 
Suburban 


SmII 
Rural 


Large 

^^^Suburban 


Student Population 


200 


300 


300 3(J0 . 


400 300 


Title I Status 




Yes 

(' ' 


No Yes 


No Yes 


NuMber of 
Regular Teachers 


10 


15 


14- 14 


15 10 


Nuaber; of 

Specialist Teachers 


.3 


5 

* 


- 7 V 7 


5 5 



Note: The data In this table are given as approxinatlons to preserve the 
samplers anonynlty* « * . 
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mmtq Bmrnll faming and fishing families. The district Is spread over a 
fairly wide geographical area* All of the districts are located In the 
Pacific Northwest. 

« ' * 

A central office administrator In. each district ^made available 
district testing results for the 1981-82 school year. Grade level 
equivalents in the two schools of dllitrlct I ranged from one year below grade 
level to grade level for the classes ihat were tested » ' Test scores In the 
two scjj^ooJLs of district II were, below the* national average in most areas of 
reading, language^ and math. Test scores In the two schools of district III 
were generally at or above the national average. 

One Item of the Interview schedules asked" teachers and administrators 
to characterise the ability level, of their students. Results for this item ^ 
ate shown in Table 5. The majority of teachers and administrators rated 
their students as being of medium ability leVel. Teachers and administrators 
were also ksked to rate their students' progress in learning the basic 
skills. As shown in fable 6, most of them were satisfied or very satisfied 
with students' progress lii the basic skills of reading, math, and language 
arts. " ' 

The school districts were not selected because they had a noteworthy 
inservice program for their teachers. They were selected primarily because 
they were accessible for purposes, of data collection and because they 
represented a range pf size and resources for schooling. One item on the 
Interview schedul^es asked thoae sampled to charactisrize their school or 
district as a climate for Inservice education and professional development. 
Results for the items are showli in Table 7. The majority of the teachers and 
all of the administrators perofeiVed that the district provided a supportive 
climate f or— ixiaejrvlce education. 

One item on the interview schedules asked teachers and administrators 
to characterize the difficulty of their work environment. Results for this 
item are preaented in Table 8. Only a third of the teachers considered their 
classes easy to teach« Similarly, only a third of the principals and 
assistant superintendents considered their schools or districts eas^ to 
administer. 

Sampling of tfeachers. It was hoped to select a random stratified 
sample' of three primary grade teachers and three intermediate grade teachers 
in each school. This procfedure would have helped to insure a representative 
sample >^of teachers across schools. However, the principals requested 
voluntary participation of their teachers in the study. They agreed, though, 
to selection of a stratl|fled grade level sample if teachers were willing. 

The sampling of teachers by grade level in each school is shown in 
Table 9. One more teacher than necessary in schools 4 and 6 volunteered to 
participate. ' They were Included in the sample. 

Because the teachers comprised a volunteer sample » their 
characteristics may differ from , the population of teachers in the 
participating schools* It is possible 'that they may be more Interested in 
inservice education than the general population of teachers. It is also ' 
possible that their Interest level Is the sami^ as other teachers; but that 
they happened to have more time available for participation in the study. 



TABLiE 5 

Ritlng of Students' Ability Level by Their 

||ii«cher8 and Adalnistrators 
(N « Nuaber of teachers*, or admlnlatratora) 



Rating of Student 



Total Sample District I District II District III 



Ability Level 


N 


X 


N 




N 


z 




Z 


1.. Teacher rating 


















High 


8 


11% 


1 


9Z 


- 5 


39Z 


2 


15Z 


Hedlum 


26 


7oj: 


8 


73Z 


7 


53Z 


11 


' 85Z 


Low' 


3 




2 


18t 


1 




' 0 


OZ 


'2. ' Adininistrator rating 


















High 


3 


33Z 


0 


OZ 


1 


33Z 


2 


67Z 


Hedlum 


5 


56Z 


2 


67% 


2 


67Z 


1 


33Z 


Low ' 

0 


1 




1 


33Z 

-,- \ 


0 




0 


OZ 



Note: Data source for item 1 is Appendix item 5/ Data source 
for item 2 is Appendix F, item 7. ' 
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TABLE 6 

Educators' Satisfaction with Students' Progress in Learning 

the Basic Skills 
(N <■ Number of teachers or adiii.ni8tra,tor8). . 

i- , . . 

Teachers 



Total Sample District I District II District III 



Basic Skills 



N 


X 


N 


Z 


N 


Z 


N. 


% 


17 


50% 


5 


46Z 




9 


69Z 


"& . 
3 


30% 


15 




4 


36Z 


4 


.31% 


7 


70% 


2 


6Z 


2 


18Z 


0 


0% 


0 


0% 


16 


46Z' 


6 


55Z 


5 


38% 


5 


45% 


16 


46Z 


• 3 


27Z 


7 


54Z 


6 


55% 


3 


8Z 


2 


18Z 


1 


8« 


0 


0% 



Reading 

Very satisfied 

Satisfied 

Dissati-sfied 



Math 

Very satisfied 

Satisfied 

Dissatisfied 



Language Arts 
Very satisfied 
Satisfied 
Dissatisfied 



10 


29% 


4 


36% 


4 


33% 


2 


18% 


20 


59% 


6 


55% 


5 


' 42% 


9 


82% 


4 


12% 


1 


. 9% 


3 


25% 


, 0 


OZ 



4/ 
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TABLE 6 
X Continued) 

Administrators 



Total Saaple Dlftrlct I District II District III 
Basic Skills • N Z N Z N Z N Z 



Reading 



Very setlsflH 


5 


56Z 


•1 


33Z 


1 


33Z 


3 


lOOZ 


Satisfied 


3 


33Z 


2 


67Z 


1 


33Z 


0 


OZ 


Dissatisfied 


1 


112 


0 


OZ 


1 


33Z 


0 


OZ 


Hath 












4 






Very satisfied 


1 


IIZ 


0 


OZ 


0. 


OZ 


1 


33Z 


Satisfied 


6 


67% 


2 


67Z 


2 


67Z 


2 


67Z 


Dissatisfied 


2 


22Z 


1 


,^3Z 


1 


33Z 


0 


OZ 


Language Arts 


















Very satisfied 


1 


IIZ 


0 


OZ 


0 


OZ 


1 


33Z 


Satisfied 


6 


67Z 


2 


67Z 


2 


67Z 


2 


67Z 


Dissatisfied 


2 


22Z 


1 


33Z 


1 


33Z 


0 


OZ 



Note: Data source for teacher table Is Appendix E^^ Iten 3* Data 
source , for administrator table Is ^pendlx H/ltem 3* 
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lUtlhg or the School and District as' ar Climate 
for Inservlce Education 
(N « Number of teachers or adiainlstrators) 



Ratings of Inservlce 
Clliiate 



Total Sample /District I District II District III 
Z / N • % N % N % 



I. Teachers' jpatlng. 
Supportive 
Neutral 
^ Un$upportlye 



32 


84Z 


9 


751 


10 


77% 


13 


lOOZ 


3 


8X 


1 




2 


15% 


0 


OZ 


3 


8Z 


2 


17% 


1 


8Z 


0 


OZ 



1^ 



2. Administrators' rating 

Supportive 9 lOOZ 

Neutral 

Unsuppottlye 



3 100% 



3 lOOZ 



3 lOOZ 



Dtote: Data source for Item 1 Is ^pendix Item 7. Data source for 
Item 2 Is Appendix F» Item 9« ^ , 
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TABLE 8 ' 
Rating bf the Classjtocm and School 
as a Work EnvlrooMnt 
<N « Number of teachers or adttlnlatratora) 



Total Sample District I District II District III 
Rating of Work Setting N X N % N 



I. (Teachers) How difficult 
Is this class to teach? 



Easy 


13 


3AZ 


A 


33* 


Medium 


11 


29Z 


4 


3AZ 


Difficult' 


14 


37i 


A 

■7 


33Z 



X 






15Z 


6 


A6Z 


39Z 


2 


15% 


A6Z 


5 


39Z 



5 
6 



2. (Administrators) How 

difficult is (are) _ . - 

your school(8) to - . ^ 
administer? 

Easy 3 33Z 1 33Z 1 331 I 33% 

Medium 1 IIX 0 OX 0 OX 1 34Z 

Difficult 5 56Z 2 ^7% 2 67X 1 33Z 



Note: Data source for item 1 is Appehdtx B, item 6. ' Data sourcie 
for item 2 is Appendix item 8. 
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^ ^ TABLE 9 ^ 

Sampling of Teachers from Each Participating School 



Number of Teachers by Grade Level 



ocnool 




1 


0 
4 






Q 
3 


0 


local 
























District I ' 






















Total 


2 


2 


2 


. 2 


2 




10 






Sample^ 


2-' 


1 


0 


- 2 


1 




6 






iotai 




















Sample 


1 


2 


0 


2 


1 




6 




Dlatrlct II 




















3. 


Total 


3 


3 


3 


3 


2 




• 14 


" IK 




Sample 


1 


1 


1 


2 


1 




6 




4. 


Total 


3 


2 


3 


3 


3 




14 






Sample 


1 


1 


1 


2 


2 




7 




District ill 




















5. 


Total 


3 


3 


3 


2 


2 


2 


15 






Sample 


0 


1 


2 


0 


2 


2 


6 




6. 


Total 


2 


2 


2 


2 


2 


2 


10 






Sample 


1 


1 


M 


1 


' 1 


1 


7 





Note: Description of teachers by ^ra^e Level In "total" rows was altered 
slightly to prefiierve the sample's anonymity. 



Our gclneral lapresslon Is that the use of volunteer schools and teachers 
resulted In i slight bias toward Including educators who are more Interested 
In Inservlce education than educators generally* ^ 

Teacher and administrator characteristics* As shown In Table 10, 
the sample of teachers Is predominantly female, and the sample of 
administrators Is with one exception male* Jthe teacHers and administrators 
both tend to have many years of experience as professional educators* 



^Measures * 

Description of Measures * ' " - ' • 

The data collection measures In this study took the form of 
seml**8tructuFed Interviews and checklists* Separate but related measures 
were developed for teachers and administrators* Except for a few slight 
changes In wording, the same measures were given to both types of 
administrator: building principal and assistant superintendent .for 
curriculum and Instruction* « All of .the measures were administered by trained 
Interviewers* * . • 4 

Each teacher measure is described belojw, followed by a description of 
the administrator measures* A copy of each measure Is lnclude<l In the 
appendix* ^ . * 

Teacher Interview Schedule I, Part One (Appendix B) • One purpose of 
this measure was t;^o obtain demographic Information about the teacfier and 
Information about her work situation (Items 1-7)* The major' purposje of the 
measure was to obtalh a list of the teacher's Inservlce activities over a 
twelve-month period extending from Juhe 1981 to May 1982^ The teacher was 

^ given a definition pf Inservlce education (item 8) and then asked to recall 
Inservlce actlvirtles moifth to month (Item 9)* Pllot-testlng of this 
procedure and experience during actual data collection Indicated that' ^ 
teac|iers had no difficulty recalling their Inservlce activities ovet this 
period of time* Item 9. provided the primary basis for answering research 

-question 1 (*'How much Inservlce education Is currently received by 
teachers* *•?")• ^ 

^ Thd consultant to the project suggested that It would be Interesting 
to obtain Information about the teacher's Informal activities that resulted 
In professional development over the same perlod'of time* Since little 
additional effort was required to collect this Information, It was Included 
i% the Interview schedule (Item 11)* The resulting data were not analyzed 
for this report, but will be analyzed at a later time* 

Teacher Interview Schedule I> Part Two (Appendix C) *^ The purpose of 
this measure was to, obtain detailed information abbut each Inservlce activity 
Identified on page 3 of Part One* Information was requested about each 
dimension in the researchers' model for describing Inservlce education 
prokrams (see Table 1 In Chapter 2)* Thus, the five sections of this measure 
areTlabelled: teacher objectives, student objectives, delivery system, 
orga^nlsatlonal context, and *govex^nce*' Therels In Tabl^ 1 a set of 
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TABLE 10 - 
Characteristics of the Teacher and Administrator Sample 





— 


Teachers 


6 


- 


CKaracterlstlcs 


Total Sample 
(N-38) 


District I 
(N-12) . 


District II 
(N-13) 


District III 
(N-13) . 


Male N 
Female N 


4 
34 

• 


2 17Z, 
ib 83Z 


^0 OZ 

13 Idoz 


2 15Z 
•jl 85Z . ' 

* w , 


Years Teaching M 
SD 


12.26 
7.02 


11.67 
7.00 


15.54 
. 7.82 


* 

9.54 
5.08 


Age M. 

^SD 


38.34 
8.89 


39.50 
10.00 


\ ^41.23 
( 9.15 


34.38 
5.48 




t 


1 




r— 



Table 10 

(Continued) 









* 


- 

- 


f 

■* , 






* 


A4mlnlstrators 










Total Sample* District 


District II 


District' m. 


Characteristics 


(N - 9) 


CN « 3) 


(N - 3) 


' (N - 3) 


Male\, 


N 


8 


3 lOOZ 


'2 67% 


3 lOOZ 


Fenale^N^. 


N 


1 ' 

^ t 


0 02 


1 , 33% 


0 OZ 


\ 

\ 












Years as 


M 


27.88 




27.00 


27.67 . 


Educator 


sp 


6.80 


9.29 


5.09 


4.99 - 


Years as 


M 


^ 17.33 


21.33 


12.67 


18.00 . 


Administrator 


SD 


9.15 


10.84 


7,59 


6.16 


* 

Years as 


M 


' 15.78 


20.33 t 


9.33 


.17.67 


Adnlnlstrator 


SD 


'9.54 


10.21 1 


8.34 


5.79 


In District 










* 


Age 


M 


50.56 


48.33 


1 ■ ' : 

51.67 - 


51.67 


. SD 


6.«5 


' 9.43 


J 4.71 

\ 


4.71 



Note: Data source for teacher characteristics Is Appendix Items l-*3« 
Data source fx>r administrator characteristics Is Appendix F, Items 
1-3. 5-6. The j^ldpolnt of the age Intervals were used as data 
tor this table: (21-25) - 23; (26-30) - 28; (31-40) - 35; 
(41-50) « 45» Educators whose age Is 55+ were assigned an 
^ . . age of 55., ' 
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dlneMlons labelled "Selection and Evaluation" that does not appear In the 
neaaure. the reason for the difference la that thla set of dimensions was 
conceptualized after the measure had been developed. Several of the 
dimensions under this label, however, are Included as Items at various points 
In the measure. 

.The Items In this Interview schedule were framed to elicit a 
description oi what occurred with respect to e^ch dimension of Inservlce 
projglrams. A]Lso, an effort was made to phrase the Item so that It could be 
xdetermlned whether a research-*based Inservlce practice (see Table 3) had 
occurred. Because our review of research literature continued past the 
development of this measure, som<p of the research findings reported in / 
Chapter 2- are not reflected In the measure. 

.. The measure included a mix of closed-form items (mostly items that 
elicited a yes/no response) and open response items. The former items were 
Intended to yield data that could be analyzed and reported within the funding 
period of the ^project, the latter items were included to provide in-depth 
data that^^bu4.d be analyzed within the funding period or at a subsequent 
point in time. 

The Items^ of this inte'rvlew schedule provided the basis for answering 
research questions 2 ("What percentage of current Inservlce activities is in 
t:he area of basic skills instruction?") and 3 ("What form do current ^ 
insei:vlc£ activities take...?''). 

Teacher Interview Schedule I, Part three (Appendix D) . After 
completing each section 6f ILhe Part Two interview schedule, the teacher 
cooyxLeted a corresponding rating form on Part Three. The five sections of 
PalPt Three correspond to the five sect lonis of Part TWo. The Part Three 
rating forms provided the basis for answering research question 4: "How 
effective and satisfying is current Inservlce education as perceived by 
educators^ , 

Teacher Intjprview Schedule II (Appendix E). The teachers were 
typically Interviewed over several sessions to collect data about ^ each of 
their inservlce activities using the Part Two and Part Three schedules. 
After those interviews were completed, the teacher was interviewed a final 
time using Schedule II. The various parts of this measure were Injtended to 
provide data for answering research question 5: "In the' opinion of 
educators,, what constitutes an effective inservlce program for improving 
teachers'' bstsic skills Instruction?" 

The first sectiqn (items 1-3) asked for the teacher's opinion on the 
Importance of basic skills instruction and her students' progress in this 
area. The second section (items 4-8) elicited attitudes toward standardized 
measures »of basic skills achievement. This type of measure was used as the 
criterion in the four Inservlce experiments described in Chapter 2. 

The third section (items 9-20) asked for the teacher's attitude 
toward various instructional practices that have been found effective in 
improving students' basic skill achievement: allocating more time for basic 
s.kills instruction (item 9), keepl,ng students on task (item 12), and bringing 
insrtructibn in line with content on achievement tests (Item 15). The teacher 
was also asked for her attitude toward an instructional strategy used in one 



of the four lnt«rvl experiments (items 18*-20) • .Several of the Items In 
this section, asked whether the teacher had ever received 'Inservlpe education 
In these Instructional, pr^ttlces. 

i ■ ' t . ■ ■ 

, The remaining^ scictlons of Schedule II elicited teachers' opinions and 
preferences regarding Inservlce dimensions In the areas of dellviery system, 
organizational context, and governance. Where possible, items asked for the 
teacher's opinion regarding a research-*vaiidated Inservlce practice. 

Administrator Interview Schedule I^ Part One (Appendix F) . This 
interview schedule served the same functions as Teacher Interview Schedule I, 
Pmrt.One. The major difference is that teachers were asked to recall 
inservlce activities in which they had participated, .whereas administrators 
were asked to ^recall inservlce activities that they had administered or 
sponsored for teachers. Item 12 of this schedule provided the basis for 
answering research question 1: '^Howtmuch inservlce education is 
„ currently., .sponsored by administrators?'* ^ 

Administrator Interview Schedule. 1^ Part- Two (Appendix G). Each 
Inservlce activity sponsoi^ed by the administrator was probed using this 
interview schedule. Items 1, 4, 5, and 6 were intended to provide, data for 
answering research question 2: /'What percentage of current inseirvlce 
activities is in the area of basic skills instruction?" The remaining jjktems 
were Intended to reveal the administrator's involvement in decision-making 
and policy-making with respect to Inservlce education for teachers* ^The 
items were outside the formal scope of work for this project but were 
included because administrators' responses to them might be useful in 
interpreting findings of the present study. The items will be analyzed and 
presented in a subsequent report. 

Admlnlstrlitor Interview Schedule II (Appendix H). This" interview 
schedule closely paralleled Teadher Interview Schedule II. Where 
appropriate, items from the latter schedule were reworded to reflect the fact 
that principals and assistant superintendents are sponsors or administrators 
of Inservlce programs for teachers. 



. Development and Administration . of Measures 

The first version of the measures was developed and pilot-tested by 
the project staff in March 1982. The major purpose of pilot-testing was to 
check the clarity of each item and to determine wliether it elicited the 
intended type of data. Another purpose was to ^heck the sequencing of Items, 
and the number of items that could fbe asked before the respondent became 
tired or restless. Also, the format of each interview schedule was checked 
to determine that there was adequate space Jj^record responses. The pilot 
tests were conducted primarily with respondenos who were graduate students 
with recent or current experience as an elementary teacher or administrator. ; 

Each measure was revised based on pilot test feedback from 
respondents and interviewers. When necessary, all or part of a measure was 
re tested to check the adequacy of the revision. 

A total of nine interviewers conducted the interviews. Some of the 
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Interviewers were prolject staff and local doctoral students. Other 
interviewers were edu:ator8 with research training who lived in or neat the 
sites that wer^ distait from the university.. 

It would have been deBirable to randomly assign interviewers to ' 
subjects in order to ^iBlnimise the effects of interviewers on ^observed group 
differences. Howeve^^, this was impossible for sever/il reasons: some 
interviewers could hot travel to distant sites; project expenses w^uld have 
increased substantially; and it would have been disruptive to a school to 
have as many as seven or eight interviewers calling on the teachers and 

.principal. <j ^ 

i ' ■ ^ ' • '■ 

The assignment of interviewers to subjects is shown oln Table 11. In 
a few e^ses (approximately 6) an interviewer could not complete all of the 
interview schedules for a particular teacher or administrator* In these 
cases a second interviewer finished the interviews. J 

Each interviewer was trained by a project staff meml>er to use the 
interview schedules. One staff member did kll of the training. Most of the 
training effort Was spent on Teacher, and Administrators Schedules I, Part One 
and Part Two. The interviewer conducted simulation interviews with the staff 
member and also conducted practice Interviews with an accessible teacher or 
administrator. 

It was expected that an interviewer could complete all of the 
measures for a teacher or adml^nistrator in three sessions of approximately 
one hour each. This time estimate" assumed that a typical educator would have 
participated in two inservice activities over a year's period of time. In 
fact, the typical teacher participated in three times that number of 
activities. « Therefore, interviews often lasted beyond an hour, .and four to 
stK interviews were usually required to complete all of the measures for a 
subject. «^ 

The interviews in districts I and II were completed in May and June 
of 1982. The inte'rviews in district III were completed in late Mjay and June, 
with the exceptions of Teacher Schedule II and ^Administrator Schedule II. 
ThTs district was recruited later than the other two districts, and many of 
the tea6hers^ an<^ administr^ors had left for the summer before Schedule II 
could be administered. These interview schedules were admiiiistered from late 
September to early November. 

.The completion of measures by participants is displayed in Table 12. 
Everyone completed Part One oi Schedule 1. With two exceptions, everyone 
also completed Schedule II. The two exceptions were teachers in the third 
district. They had been available in Spring when Schedule I was 
administered, but they went on leave in Fall when Schedule II was 
administered. ■ ■ :. -^^ 

As stated above. Part Three of Teacher Interview Schedule I was 
administered whenever l^^rt Two was administered. Therefore, the "Complete** 
column of Table 12 includes the number of completed matched pairs of Part Two 
and Part Three schediiles for each teacher. Because of the unexpected' high 
frequency of inservice activities, ^t was not always possible to collect data 
on each activity recorded on Teacher Interview Schedule I, Part One. The^ 
time required to complete all of these schedules was too great for some 
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TABLE 11 

Asslgnaent of Interviewers to Teachers and Adalntstrators 



District I 



Inter- 
viewer 



Dlstrlfitll 



Inter- 
viewer 



District III 



Inter- 
viewer 



School L 
Teacher 1 
2 
3 
4 
5 
6 

Principal 



A 
A 
A 
B 

C 
C 
D 



School 1 
TeacherT 

2 
3 
4 
5 
6 

Principal 



F 
F 
-F 
F 
F 
F 
F 



School J|_ 
Teacher 1 
2 
3 
4 
/5 
6 

Principal 



H 
H 
H 
H 
H 
H 
I 



School 2^ 
Teacher ' 1 

2 

,3 
4 
5 
6 



A 

A 

C 
C 
C 
E 



Principal D 
Asst. Supt. D 

) 



School 2 

Teacher 1 G 

2 G 
• 3 - G 

4 G 

5 G 

6 G 

Principal ^ B 

Asst. Supt. B' 



School 2_ 
Teacher 



J 


H 


2 


H 


3 


H 


4 


H 


5' 


H 


6 


I 


7 # 


I 


1 


J 


• 


J 



Note: Each letter In the- Interviewer, columns represents a different 
Interviewer. 




TABLE 12' ^ 
Number of Measures /Completed by Bach Teacher and Administrator 



District I 


0 Part 
One 


/ 

/ Parts Two^nd Three* 
/ Complete Not Dotie 


Schedule 

' li 

• 


ocnooj. 1 








Teacher 1 


+ 


12 




2 




7 


+ 


3 


+ 


4 , 




4 


+ 


^ 9 , / 


+ 


5 






+ 


6 




6 


+ 


Principal 


+ 


3 


■ ^ * . • 


School 2 








Teacher 1 


+ 


5 ^ 




2 


+ 




+ 


3 


+ 


13 .1 




f\ 




4 




. ^ 5 


+ 


' 3 ' ; 


+ 


6 




5 


+ 


Principal 


+ 


2 




Asst. Supt. 


+ 


1 













* Principals and "assistant superintendents only completed Part 
Two for Administrator Schedule I. 



Part ' Parts Two and Three , Schedule 
Distfrlct II One Complete Not Done 'II 



School J_ 
Teacher 



1 
2 
3 
4 
5 
6 

Principal 



+ 
+ 

+ 
+ 
+ 
+ 



6 
7 
8 
7 
7 
-•4 
' 3 



7 
7 
2 
2 
1 
1 



+ 
+ 

+ . 

+ 
+ 
+ 



School 2 
Teacher 1 
2 
3 
-4 
5 

. 6 
7 

Principal 
Asst. Supt. 



+ 
+ 
+ 

+ ; 

+ 

+ 

+ 
+ 



3 
7 
6 
5 
3 
6 
4 
5 
3 



+ 
+ 

+ 

+ " 

+ 



TAI^E 12 
(Continued) 



Plstrlct III 



P»rt Parts IWo and Thr«e Schedule 
One Coiiplete . Mot Done IX 



School 1 



Teacher 1 

2 
3 
4 
5 

. ■ ' .6 
Principal 



+ 

+ . 

.+ 

+ 

+ 
+ 



7 

A 

3 

A 

5 

6' 

3 



1 
2 
2 



+ 
+ 

+ 
+ 
+ 
+ 



School 2^: 
Teacher 1 

2 
3 
4 
'5 
6 
7 

Principal 
Asst. Supt. 



+ 
+ 
+ 
+ 
+ 
+ 
+ 



2 
6 
4 
3 
4 
6 
4 
3 
2 



+ 
+. 

_+ 
+ 

+ ■ 
+ 



ERIC 



53^'^ 



te«chertt, especially teachers with a itlgh frequency oflnservlce 
participation. The tine demands for these teacfters exceeded the time 
estimates that they had been given at the outset when they were recruited for 
the stydy/ The Interviewers were instructed not to 'Vear out their welcome." 
They were also Instructed to use Parts Two and Three for the most Important 
activities, and to obtain a brief summary description of the other 
activities. * 

School district I caused n6 difficulty. With one exception (teacher 
3 in school 2), all activities we^e probed using the Pairr and Three 
schedules. School 1 In district 2 had a substantial number of inservice 
activities %f or whicl/ Part Two and Three data were not collected. The number 
of Inservice activities in this school was high: with one exception, each 
teacher had more inservice activities than the most active teacher (no; 2) in 
school 2. The Int-ervlewer completed as many Part TWo-Three schedules as 
possible within the time* available. School 1 in school district III also had 
a substantial number of Inservice activities not probed by Part TWo and Three 
schedules. n The teachers in this school were very busy at the end of the 
school year, and so it was difficult to arrange sufficient tiiie for all of 
the int.erviewlng that was required. ' ; 



CHAPTER 4 
RESULTS 



Data Analysis Procedures ^ 

The research questions posed in jthls study generally call for 
descriptive Inquiry* Therefore, all of the data analyses presented In this 
chapter are suanarlzed In the f ors of descriptive statlstlcsr frequency 
counts, percentiigesy jseansy and standard deviations*' Many of the tables 
present descriptive statistics for the total saaple and for each of the. three 
school districts* Tests of statistical significance nere not d9ne^ on 
observed between^lstrlct differences, though* It did not se^ea reasonable to 
use lnfere|!itlal statistics to nake general^lsatlons about population 
parssetera f roB saaple siatlstlcs when the sample (In this esse, school 
districts) vas not randooily drawn from a clearly defined population of school 
dls|:rlcts and when subjects within districts comprised a volunteer sample* 
The analysis focused Instead on the observed magnitude of dlstrlct«-levcl 
differences to determine whether the districts generally similar to each 

other In Inservice practices. and perceptions* 

Inspection of the data suggests that Inservice education Is generally 
organized at the district level rather than at the school level* With a few 
exceptions then, the analysed focus on teacher and administrator data 
aggregated to the district level* It is important to realize that 
dlstrlct«-level data analyses do not imply that the activities wete 
district-sponsored* An activity was assigned to a district only because the 
teacher who participated in .the activity worked in the district* The 
activity may have been dlstri;ct--spOK|sored or sponsored completely outside of ' 
district auspices* 

As described in Chapter 3» different Interviewers were assigned to 
different schools and different districts* Therefor^/ it is possible that 
observed group differences reflect district effects or interviewer effects* 
Efforts were made to standardize tK<e interviewing procedure » but there is no 
way of knowing for certain how well Intetvl^r bias was controlled in this 
study* Observed differences between districts should be Interpreted 
cautiously* 

** 

^ Two different units were used in the statistical analyses* In scare 
analyset the individual educator (teacher^ principal*^ or assistant 
superintendent) was the statistical unit* The individual inservice activity* 
however* was used as the statistical unit in analyses' of data frqm Teacher 
Schedule I* Parts Tuo and Three* and from Administrator Schedule I* Part Two* 
The number of Inservice activities varied ^substantially between teactiers* 
The range was from 3 to 15 jictlvltles* When this much Vange occurs* data for 
individual inservice activities can become unduly weighted when aggregated to 
the teacher level* ^ 

The problem of aggregration can be Illustrated by this example* 
Suppose a teacher participated in three Inservice activities* all of which 
were aandatory* Another teacher participated in ten inservice activities* 
only three of which were eiandatory* This situation can be depicted as 
follows (M « metidAtory, V « voluntary) : 



erJc ^^<: 




Teacher IT*' M M M / ' 

Teacher 2: M M M V V V V V V V - ( 

A iuraary statistic to describe mandatory Inserylce can be calculated In tw6 
ways.; If the teacher la the unit, one would coiipute the percentage for each 
teacher (XOO percent; 30 percent) and divide by N (In this case, 2) yielding 
a mean percentage of 65 percent. If the Inservlce activity ^Is the unit, one 
would sum the mandatory activities (N « 6) an^ divide by the sum of all the 
activities (N « li3), yielding a percentage of 46 percent. The difference 
between the two statistics (46 percent 65 percent) Is Substantial. 

It was decided that the analyses for this report would use the 
Inservlce activity as the unit of statistical analysis. This unit has the 
advantage of giving more weight to teachers who have been frequent 
participants in Inservlce activities. At the same time, we realize that 
there are insights that can be gained by aggregating inservlce activities so 
that the teacher Is the focus of statistical description. Such analysis is 
beyond the scope of the present report. A few Important variables, though, 
have been analysed at both levels hete. 

, " ■ f 

The ^Inservlce activities reported by different teachers are not 
necessarily independent events. Teachers from the same school and from the 
same district often attended the same inser.vice activity, for example, a 
beginning-of-year orientation meeting organised by the district. The extent 
to which activities overlapped among teachers is represented, to a degree, in 
the data analyses concerned with the organizational context of inservlce 
education (see pages 78-83). The overlap of activities poses no special ^ 
methodpJ^ogical problem. The reader should keep in mind, though, that data 
analyses in which the inservlce activity is the statistical unit are not 
dealing with completely independent events. 

Missing data were negligible because data were collected through 
in-person interviews with each educator in the sample. There are a few 
missing data entries because the interviewer skipped over an item qr forgot 
to record a response. Also, missing data occurred when a teacher did hot 
record a response onf the rating forms on Teacher Interview Schedule I, Part 
Three. In tables Where the teacher is the unit of analysis, missing data can 
be^ inferred when total N is less than 38 or when district Ns are less than 12 
(district I) or 13 (districts II and IIB). An exception to this rule is that 
N should be 11 for district III In analyses involving Schedule II; this, is 
because two teachers were on district leave when this schedule was 
administered. Missing data for administrators can be inferred when total N 
is less than 9, when principal N idPliess than 6, or when assistant ^ 
superintendent N is less than 3. 

When tjeacher inservlce activity is the unit of statistical analysis, 

missing data can be inferred when: 

. # - • • 

Total N is less than 213. V 
District I N is less tlian 82. 
District II N is less than 73. 
District LII N is less than 58* , 

J' ^ 

When administrator inservlce activity ip the unit of statistical analysis, 
missine^^ data can be inferred when: 



Total N l8 lets than 25. 
District I N ia lasa than 6. 
Dlatrlct II Nna leaa than 1I« 
.Dlatrlc^ III N la leaa than 8. 
Principal N la laaa than 19* 
Aaalatatit SuperlntcMlant N la leaa than 6* 

The data aource for the ausnuiry atatlatlca In each table la given In 
a note to the table* Theae .notea refer the reader to the appendix containing 
the appropriate Interview achedule. The auraary atatlatlca for data relating 
to an Interview Item aoaetlaea follow the reaponae optlona for the Item; for 
example/ yes/no* However , rating acalea are uaually collapaad to a amaller 
number of valuea for data preaehtatlon unleaa It aeema Important to preserve 
the total scale* For example, the aatlafactlon acalea In Ap*pandlx D (very 
aatlafled, satisfied, <Ilssatl8f led, very dlaaatlaf led, not applicable) were 
uaually collapaed to tlkee valuea: aatlafled, diaaatiafied, not applicable* 
The reaulting tablea of reaulta are more eaally interpreted. Alao, the 
validity of the diat^^ction between adjacent valuea auch aa *'very aatlsfled" 
and "satisfied" la uncertain. 



Reaearch Queatlon 1 
How much inservice education is currently received 
by teachera and aponaored by adminlatratori? 

' Teachers werfB asked to recall the number of Inaervlce activities in 
which they had participated during a twelve-^onth period (a aummar and ^he 
following school year)* An ihservice activity waa defined aa any event, 
however brief or long, that la intended to improve the teacher 'a capacity aa 
a profeasional educator. 

The number of inaervlce activities recalled by each teacher la ahown 
in. Table 13. The mean number of activitiea (7.34) la mx6h greater than that 
reported in previoua research* There Is between-^district variation, but it 
la hot aubstantial. The moat noteworthy group difference 1^ batilaan the two 
achoola in district XI* . The mean frequency in achool 1 la twice that of 
achool 2. The betweenrteacher variation la alao very aubatantlal. There la 
a small cluster of teachera with ftwer than 5 activitiea and another cluater 
of teachera with 10 to 15 activitiea* 

(I 

1^ ■ 

The nimiber of teacher inaervlce activitiea aponaored or admiiiiatered 
by principals and aaaistant auperintendenta la ahown lA Table 14. Moat 
noteworthy is the fact that each admlniatrator waa Involved in at leaat one 
teacher inaervlce activity, and aeveral were Involved in 4 or more* Aa with 
teachera, there waa aubatantlal variation between prlncipala and aaalatant 
auperintendenta in number of activitiea aponaored or adminlatared. 

Number of activitiea la a limited' index of teacher and admlniatrator 
involvement, in inaervlce education. Extent of involvement alao naed^ to Jbe 
Indexed by meaaurea of the length of the activitiea* Data on the number of 
houra required by each activity la displayed in Table 15. Theae data are 
teacher reporta of the length of each activity in which they participated* 

Fully half of the Inaervlce activitiea ahown in Table 15 are 4 houra 

er|c' 



TABLr 13 

Frequency pf Teacher Inservlce Activities 
(N * Number of Inservlce activities) 



District I District II District III 
Teacher - Nr . . N " N 



School ■' ■ 

1 ,12 13 8 

2 . 10 14 ^ 6 

3 6 10 t 8 

4 9 10 8 

5 » 7 8 5 

6 . 6 .5 8 

_ School 2_ ^ s • ~ 

1 13 3 2 

2 8 9 • 8 
. 3 . 15 6 7 

4 4 5 5 

5 6 3 A 
' -6 - . 5 ■ ' 6 8 

7 ' ' 4 5 



School 1 M 



8.33 10.00 7.17 



School 2 M ' 8.50 5.14 5.57. 

District M 8.42 7.38 6.31 

SD . ' 3.30- 3.48 1.90 



Total (N-38) M 7.34 
SD 3.09 



Note: Data source is the frequency of activities recorded for 
Appendix B, item 9. 




TABLE 14 

Frequency of Inservlce Activities' Sponsored by 

Principal^ and Assistant Superintendents 
' (N-«^ Number of Inservlce activities) 



Administrator 



N 



District. I 

PrlhdpBl, School 1 
Principal, School 2 
Assistant Superintendent 



4 
2 



District II 

Principal, School 1 
Principal, Scho.ol 2 
Assistant Sup^rHitendent 

■■// 

District III // 

' Principal, sdhool 1 
Principal, School 2 
A8 8:j.8tant Superintendent 



3 
6 

7 



4 

4. 
.2 



-> r 



Principal * M 

Assistant Supe'trintendent M 



3.83 
3.33 



'Note: Data source is the frequency of activities recorded for 
Appendix F, item>12. 
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TABLE 15 

N^istrlbutlon of Durations of Teacher Inservlc6 Activities 



No. of 
Hours 




1 

% 
3 
4 
. 5 
6 

^ 7 
8 
9 
10 

13 

14 

17 

18 

20 

22 

24 

25 

30 

32 

34 

35 

38 

40 

44 

45 

48 

53 

56 

64 

70 

80 
100-125 
126- 192 



13Z 
34Z 
46Z 
53Z 
59Z 
66Z 
68Z 
74Z 
75? 
772 
81Z 
81% 
82Z 
82Z 
83Z 
84Z 
I 85Z 
I 87Z 
I 87Z 
89Z 
90Z 
91Z 
91Z 
92Z 
93Z 
94Z 
94Z 
95Z 
95Z 
96Z 
97Z 
. 97Z 
98Z 
99Z 
lOOZ 



Bar Graph of Nunber of Activities 



XXXXXXXXXXXXXXXXXXltXXXXXXXXX 

XXXXXXXXXXXKXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
XXXXXXXXXXXXXXXXXXXXXXXXX , ' 

XXXXXXXXXXXXXX 
XXXXXXXXXXXXX 

XXXXXXXXXXXXXXX , 
XXXXX ♦ 
XXXXXXXXXXXXX 

JCX ^ - " ' 

-xxxx , 

XXXXX](X 

X : 

X 

X • . ' 

X 

xxxx 

X " , . 

xxxx 

X " 
XXX - , * 

XXX 

X , 

,x 

X / 
XXX 

XX _ ■ 

X 

X 

X 

x 

X • . . 

XX 

XX , - 

XX s . 
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Note: Data source Is Appendix C, Item 18e. 



or less, A modest skill training program for teachers mlgbt be 30 hours or 
■ore (Borg et al, 1970). Only 11 percent of the Inservlce activities w6re of 
this duration or longer/ A typical university course for teachers Is 3 
credit hours, which Ihvolves 30 contact hours with t^e professor plus an 
estimated 60 Individual hours o^ Independent study. Only 2 percent of the 
^Inservlce activities were as long as the 90 hours required for a university ^ 
course that lulght cover one topic In depth,. " ."^ 
» ■■ • ' 

Data on scheduling provide additional Insight Into the length of 
Inservlce activities. These data are summarized In Table 16. Almost 
three-quarters of the activities are scheduled for one meeting (the "all at 
once" variable In Table 16). Ninety-one percent are completed within a 
school term. Research on curriculum Implementation suggests the need for a 
time frame of 3 to 5 years for Incorporating an innovation into a school 
system. Just 1 percent of the Inservlce activities lasted a^year or more. 

y There is little variation between districts in the incidence of 
oriS^^ot Inservlce activities (72 percent, 73 percent,, and 69 percent). 
There is more between-dlstrlct variation in occurrence of Inservlce 
activities lasting more than a school, term (13 percent, 7, percent, and 4 
percent) * 

Taken together. Tables 13, 15, and 16 characterize Inservlce ^ 
activities as a relatively frequent occurrence for teachers, but they are 
mostly one-shot events of short duration. The model of Inservlce education 
in which a few school Improvement priorities are worked on by a school staff* 
over a substantial period of time is weakly represented, if* at all, in thescf 
data. ^ ' 

The extent of participation in Inservlce activities was also' analyzed 
for individual teachers. This analysis Involved summing the number of hours 
of all the Inservlce activities in which a particular teacher partlclt>ated. 
The results of this analysis are shown in Table 1^. The extent of variation 
is large: two teaq^ers ^ach reported a total of only 12 hours of Inservlce 
activity, whereas two other teachers reported a total of approximately 250 
^ours. .There is much less .variation between schools, with one jexception. ^ 
One of the schools in district I had Just one-third the number of Inservlce 
hours of any of the other schools in the sample. There is scne variation 
when the data are aggregrated to. the district level, but tills variation is 
largely a function of the one school in district I. 

The mean numb^t of Inservlce hours for the total sample of teachers 
is 73.34. Using 8 hours as the equivalent of one work day,. 73.34 hours 
equals Just over 9 work days. This means, then, that the typical teacher is 
Involved in Inservlce activities for almost 2 weeks each calendar year. 

The median numbex of Inservlce hours for the total sample is 46 
hours. This is a substantially lower figure due to the skewed distribution 
of* the data. The figure of 46 hours equals approximately 6 work days, or. 
Just over a week of Inservlce activities each calendar year. 

Table 18 presents examples ol itservice activities that are of brief 
or long duration. The six longest activities and a random selection of 
one-hour activities (two from each district) are Included. Four of the six 
longest activltJLes Involved university coursework. Just one of the brief 

, 61 , t>0 



TABLE Ify 

' Scheduling of Teacher Inservice Activities 
(N " Number of activities) 



Scheduling of Activity ' Total Sample District I District II District II 



^ — ' ^ 

N Cum N N Gum N N Cum N N Cum N 
X ■ X X ' X 



All at once 


141 


723: 


59 


72% 


49 


73% 


33 


69% 


Over perfod of few days 

' ; 


8 


76Z 


3 


76% 


4 


79% 


1 


71% 


Over period of week 


9 


80Z, 


0 


76% 


4 


85% 


5 


81% 


2-4 weeks 


6 


83a: 


2 


78% 


0 


85% 


4 


90% 


5-8 weeks 


6 


86Z 


3 


82% 


2- 


88% 


1 


92% 


A school term 




91Z 


4 


87% 


3 


93% 


2 


96% 


Two. terras 


9 


95% 


7 


95% 


2 


96% 


0 


96% 


A year 


7 


99Z 


4 


100% 


2 


99% 


1 


98% 


More than a year 

9h 


2 


100% 


0 


100% ' 


■ 1 


100% 


1 


100% 



Note: Data source is Appendix C, item 18c. 
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TABLE 17 ■ 

Number of Hours of Inservice Activity Per Teacher 
Over a One-Year Period 



Teacher 



District I ' District II 
Hours Hours 



District III 
Hours 



School 1 



1 
2 
3 
A 
5 
6 



90 
256 
12 
40 
40 
19 



132 
142 
39 
34 
65 
52 



83 
88 
20 
124 
147 
29 



School 2 



School 1 
School 2 

District 



1 
2 
3 
4 
5 
6 
7 



M 

k 

M 
SD 



32 
27 
46 
19 
18 
12 



76. 1> 
2^.67 

50.92 
65.15 



15 
100 
115 

59 

38 
251 

17 



77.33 
85.00 

81.46 
63.60 



47 
65 

177 
95 
14 

175 
53 



81.83 
89.43 

85.92 
53.56 



Total (N - 38) 



M 
SD 



^73. 34 
62.78 



Median ■ 46 



Note: Data source Is Appendix C, Item 18e. 
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TABLE 18 

Examples of Brief and Long Inservice Activities 



Brief - Aptivities 

1. (1 hour) Teachers were trained how to teach students the mechanics 
of test-taking. . 

2. (1 hour) tA workshop on how to teach students about energy. 

3. (1 hour) A presentation on rape awareness. 

4. (I hour) School district orientation at beginning of school year. 

5. (1 hour) Inservice on district's program to Improve students' 
writing skills. 

6. (1 hour) Orientation of cooperating teachers to student teacher ^ 
'Supervision. ^ 

L6ng Activities 

7. (125 hours) University course on beginning computer programming. 

8. (80 hours) University course, "Connseling for the Classroom Teacher." 

9. (SO hours) Participation in district's "Instructional Theory Into 
Practice" program^ . 

10. (128 hours) Five university courses toward a master's degree in 
curriculum and instruction. 

11. (100 hours) Inservice program on outdoor education. 

12. (192 hours) Three university courses toward a speciaP education 
certificate. 
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InservlM activities (no. 6) was university-based. Also, just one of the 
long inservice activities (no. 9) was clearly a school Improvement effort. 

Research Question 2 
What percentage of current inservice activities is 
In the area of basic skills instruction? 

The data used to answer this research question came from teachers' 
descriptions of the teacher objectives (Appendix C, item 1) and student 
objectives (Appendix C, it^ 8) for ^ach inservice activity. Each 
description was transcribed onto a separate sheet of paper. A content 
analysis procedure was developed to code the inservice topics mentioned in 
these descriptions. A total of 18 topics were cod^d. (The list of topics 
appears in Table 19^) • The content analysis procedure is described in 
Appendix I* , 

Each inservice activity was scored by two raters • Two types of rater 
disagreement could occur. Because inservice activities could include more 
than one inservice topic according to the content analysis procedure, raters 
could disagree on the number of topics represented by a set of itti|ervice 
activities. A reliability check on 78 of the activities indicated^ 
disagreements on number of topics. This is a disagreement rate of 8 percent. 
The raters resolved their disagreements on this variable before checking on 
the accuracy of their coding of activitids by topic. A reliability check 
indicated 15 percent disagreement in coditig^of topics. Disagreements were 
resolved by discussion between the two raters. The disagreements were 
generally attributable to vagueness in teachers' descriptions or in 
Interviewers' transcription of the descriptions. 

A total of 246 inservice activities were available for content 
analysis. This total Includes 33 more activities than were included for data 
analyses involving Parts Two. and Three of Teacher Interview Schedule I (N « 
213 activities)* These additional activities were briefly recorded by the 
interviewers even though the Part Two and Part Three schedules were not 
completed. The 33 additional activities corresj/pnd to the "Not Done" 
activities in Table 12. (Table 12 actually includes 35 "Not Done" 
activities, but 2 of the activities had no description available for content 
analysis.) 

Of the 246 actiyities that could be content-anglyzed, 210 covered a 
single Inservice topic each. The other 36 activities covered 2 inservice 
topics each. 

Table 20 presents the frequency ^nd percentage of Insetvice 
activities that dealt with each topic. Six 'of the topics were considered to 
be in the area of basic skills: reading, math, language arts, handwriting, 
composition, and spelllnjg. More than one-third of the inservice activities 
were concerned with basic skills instruction. Twenty-seven percent of the 
inservice activities were concerned with specific areas of the elementary 
school curriculum such as art, 'science, music, and social studies. One-third 
of the inservice activities dealt in a more general way with iiatters of 
elementary ctirriculum and instruction. Examples of top^ics included in this 
category are: cla«isroom discipline, teaching the learning disabled, computer 
education, and Madeline Hunter's ITIP (Instructional Theory Into Practice) 



^TABLE 19 

List of Inservice Topics Included in Content Analysis System 
Basic Skills ^ 

1. Reading. Ex.: workshop sponsored by International Reading Assoc. 

2. Math. £x.: Inservlce meetings to discuss a pilot program to help 
students develop math problem solving strategies. 

3. Language Arts. Ex.: inservlce program to develop instructional 
materials for reading and writing. ^ 

4. Handwriting. Ex.: inservlce o^ district adoption of new hand- 
writing program. . 

5. Composition . Ex.: inservlce on holistic writing program an3s^ 
how to implement it. ^ 

6. Spelling. Ex.: inservlce on adoption of new spelling program. 
General Academic 

7. General Academic. Ex\ : lecture on effective schools research. 

8. Handicapped & Gifted. Ex.: inservlce on role of career 
education in special education,. 

9. Management & Discipline. Ex.: workshop on achieving positive 
classroom behavior. 

Specific Curriculum Areas 

^0. Art. Ex.: workshop on how to use paper scraps for art projects. 

11. Career Education. Ex.: inservlce on career awareness and sex 
equity. 

12. Music. Ex.: workshop on how to play the^ autoharp. 

13. Mental Hygiene. Ex.: inservlce session on how to help students 
• deal with personal loss and death. 

r 

14. Physical Education. Ex.: workshop on how to do exercising 

to music* 

15. Science. Ex.: inservlce on how to teach energy conservation to 
students. 

16. Sodial Studies. Ex.: inservlce on how to do social studies 
, textbook adoption. 

Professional & Personal 

17. Professional & Personal. Ex.: inservlce on mental health and 
stress for teachers. 

18. District 6^ School Policies. Ex . : beginning-of-year orientation 
to district policies concerning pupil discipline problems. 
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TABLE 20 

Relative Frequency of Intervlce Topics for Total S,ample 
(N > Number of Inaervlce activities) 



Topic 



- N 



Z * 



Cum ** 
% 



Basic Skills 



Reading 
Math 
Language Arts 
Handwriting 
Composition 
Spelling 



26 
24 
23 
7 
5 
4 



IIZ 
lOZ 
9Z 
3Z 
2Z 
2Z 



37Z 



General Academic 
General Academic 
Handicapped & Gifted 
Management & Discipline 



59 
10 
9 



24Z 
4% 
4Z 



32Z 



Specific Curriculum Areas 
Art 

Career Education 
Music 

Mental Hygiene 
Physical Education 
Scient:e 

Social Studies 



12 
5 
6 

3 

12 
25 
6 



5Z 
2Z 
2Z 
1% 
5Z 
lOZ 
2Z 



27Z 



Professional &^ Personal 

Professional & Personal ^ 
District & School Policies 



28 
15 



IIZ 
6Z 



17% 



* The percentages are the number of activities covering a topic 
divided by the total nximber of inservice activities (N ■ 246). 

** The cumulative percentage for each category is the number of 
activities covering the topic divided by the total number of 
inservice activities (N * 246). Occasionally an activity 
would cover more than one topic within a category, but their 
incidence Is low (N * 5 or less) and would not affect the 
cumulative percentages. Note also that the cumulative per- 
centages add up to more than 100 percent because there are 
more topics (numerator) than activities (denominator). 
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program. Plrially, 17 percent of the Inservlce activities concerned district 
and school policies, and personal and professional development. 



Table 21 presents the same statistics as Table 20 but at the district 
level. There is little betwcen-iiistrict variation in overall emphasis on 
inservice activities relating to basic skills inbtruction. There are 
substantial district differences itt emphasis on specif ic basic skills topics, 
however. Only district I emphasised reading. District III' had virtually no 
math inservice, and district I had very little ^language arts inservice 
relative to the other two districts. Other categories of inservice content 
also vary substantially. District I emphasized inservice on specif iq areas 
of the curriculum; district III emphasized intervJLce on general curriculum 
topics; and district II emphasized inservice on professional and personal 
development • » ^ - 

■ f . ' 

Table 22 presents the same data as in tables 20 and 21 but organizes 
them at the individual teacher level. ^ Each '^XV In a column of the table 
indicates that the teacher participated in at ieast one inservice activity on 
the topic represented by that column. The table reveals that each teacher in 
the district I simple participated in at least one reading inservice. Almost 
every^acher in the district II sample participated in at least one language 
arts inservice. No basic skills priority was evident .in district III, 
although generally the various aspects of language arts curriculum were 
enlphasized. With respect tcr the other curriculum areas, only district I 
revealed any priority areas for inservice (in physical education and 
science). 

. • 

Tables 20, 21, and 22 together create a picture of an inservice 
program that Is fractionated over many topics, with a few priorities apparent 
in basic skills instruction (especially reading inservice ii^ district I). 
The 18 categories used to group the inservice topics <io not fully represent 
the extent of fractionation. Categories like "general academic," "science," 
and "professional/personal", each Include a wide .range oi inservice topics.. 

Table 23 presents the inservice topics sponsored by the principals 
and assistant superintendents in the sample. The coding procedure wa^ 
exactly the same as that used for coding teacher inservice activities. Each 
administrator activity was double-coded. Interrater reliability was good (90 
percent agreement); differences were resolved by discussion between the 
raters. c 

The topics shown in Table 23 indicate that principals and 
superintendents mostly sponsor inservice activities on basic skills 
Instruction. Seventy-six percent of the inservice activities dealt totally 
or 1^ part with basic skills instruction. This is double the percentage for 
the activities in which teachers participate (37 percent; see Table 20). 
Also, most of the basic skills inservice activities sponsored by 
administrators are in the area of language arts instruction, whereas 
teachers' activities are dispersed over more categories of basic skills 
instruction. 

Table 24 presents educators' perceptions of the pertinence of each 
inservice activity to basic skills instruction. Interestingly, 
administrators rate 83 percent of their sponsored .inservice activities as 
pertinent or very pertinent to basic skills instruction. This Is close to 
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* TABLE 21 

Relative Frequency of Innervic^ Topics for Each District 
(N - Nimber of inservicc activities) 



District I District II District III 



Cum * 



Total 




% 


Z 


N 

• 


% 


Basic Skills 












1. Reading 


17 


20% 




A 


4% 


1. Math 


10 


12% 




13 


14% 


3; Language Arts 


3 


4Z 




16 


18% 


4* Handwriting 












5* Composition 


2 


11 


. . 






6« ^Spelling 


















38% 






General Academic 












7« General Academic 


22 


27% 




18 




8« Handicapped & Gif te*d 








2 


2% 


9« Management & Discipline 


1 


1% 




2 


2% 








28% 






Specific Curriculum Areas 




5% 






4% 


10. Art 


4 




4 


11. Career Education 


1 


1% 




4 


4% 


12. Music 


6 


7% 






1% 


13. Mental Hygiene 








1 


14. Physical Education 


12 


15% 






8% 


15. Science 


12 


15% 




7 


16. Social Studies 








2 


2% 








43% 






Professional & Personal 












17. Professional & Personal 


4 


5% 




. 16 


18% 


18. District iSthool Policies 








15 


16% 



Cum** 
% 



Cum*** 



N 



36% 



24% 



19% 



5 
1 
4 
7 
3 
4 



6 

4 



8% 
1% 
6Z 
10% 
4% 
6% 



19 26% 
8 11% 
6 8% 



6% 



3%; 

8% 
6% 



8 11% 



35% 



45% 



23% 



5% 



34% 



11% 



* Total activities withinia category divided by 82 activities. 
** Total activities withinU category divided by 91 activities. 
*** Total activities within a category divided by 72 activities. 
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TABLE 22 

Number of Teachers Participating in Inservice Activities 
^ on a Particular Topic 

(N • Number of teachers) 

♦ District I ' 





, Basic Skills 


wctic & ox 




Specific Curriculum^ 


r^LijL / r^ct ouiicix 




1 9 A S f> 


7 R 


Q 


in 11 


1 9 
1 ^ 


1 *^ 1 A 


1 <\ 1 A 
ij ID 


1 7 1ft 
1 / lo 


1 


XXX 


X 






X 


X 






' 2 


'XXX 


X 




X X 


X 


X 


X 




. 3 ' 


X 


V 

#* 






X 


X 


X 




4 


X X 


X 








X 


X 




5 


X X 


X 




X 




X 


X 




6 


X X 1 


X 




X 






X 




7 


X X / • 


X 




X 


X 


X 






8 


X X / 


X 






X 


X 




X 


9 


X x/ 


X 


X 




X 


. X 


X 


X 


10 




X 








X 






11 




X 














12 


X 

/ ■ 


X 










X 




N 


12 7 2 0 2 0 


12 0 


1 


4 1 


6 


0 9 


8 0 


2 0 


District II 


Teacher 


Basic Skills 


General 


Academic 


Specific Curriculum 


Prof /Personal 


ID 


• 1^ 2 3 4 5 6 


7 8 


9 


10 11 

X 


12 


13 14 


15 16 


17 18 


13 


X X 


X 


X 


X 






X 


X 


14 


XXX 


X 










X 


X 


15 


X XX 


X 




X X 








X 


16 




X X 




X X 






X 


X X 


1> 


XX X 


X 










X 


X 


18 




X 




X 






X 


X 


19 


X 


K 














20 


XXX 


X 




X 






X 




21 


XXX 


X 












X 


22 


X 


X 










X 




23 


X 




X 












24 


X X 


X 












.X X 


25 


X X 


X 














N 


4 8 11 1 0 0 


11 2 


2 


3 4 


,0 


1 0 


6 2 


8 2 
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TABLE 22 
(Continued) 



District III 



Teacher Basic Skills General Acadenlc Specific Curriculum Prof /Personal 
ID 12 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 



26 




XX X 


X X 


X 






X 


X 




' 27. 




X X 


X 


X 




X 


X 






28 


X 


X 


X X 






X 




X 




29 




X X X X 


X X 










X 




30 




XXX 


X 






X 








31 


X 


X 


X X 


X 


X 


X 


k 






32 




X 


X 














33. 


X 


X 


XX 






X 






X 


34 




X 


XXX 










X 


X 


35 






XX 




X 








X 


36 






XX 










X 


X 


37 


X 


X 


XX. 












X 


38 


X 


X 


X 














N 


5 


1 4 7 3 4 


12 6 5 
• 


3 


0 0 2 


0 5 


3 


5 


6 



Note: The InserVlce topics represented by the number designations beneath 
each content category can be determined by referring^ to Table 21. 
For example, 1 - Reading, 2 « Math. / 
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TABLE 23 \ 

Topics of Inservlce Activities Sponsored by Principals 
and Assistant Superintendents 



District I 
To^ Xcs 



District II 
Topics 



District III 
Topics 



Principal » . School _1 

1. (BS) Math 

2. (BS) Language arts 

3. <BS) Language arts* 

4. (SC) Mental Hygiene* 



Principal , School 1^ 
1. (BS) Math 
2: (BS) Language Arts 
3. (BS) Language Arts 



Principal p School 1^ 
TI (BS) Language Arts 

2. (BS) Language Arts 

3. (PP) Professional 
and Personal 



Principal, School 2^ 

T. (SC) Music 

2. (SC) Mental Hygiene 



Principal, School 2 
1 • (BS) Language Arts 

2. (BS) Language Arts 

3. (BS) Composition 

4. (GA) Handicapped 
and Gifted 

5. (SC) Art 



Principal, School 2^ 

1. (BS) Language Arts 

2. (BS) Language Arts 

3. (PP) Professional 
and Personal 



Asst> Superintend fi i nt 
1. (BS) Language Arts 



Asst « Superintendent 
"n rBS) Language Arts 

2. (BS) Composition 

3» (BS) Language Arts* 

3. (GA) Handicapped 
and Gifted* 

3.. .(SC) Physical 
Education* 



Asst « Superintendent 

1. (BS) Math 

2. (BS) Language Arts 



Note: BS » basic skills; GA " general academic; SC specific curriculum 
area; PP » professional and personal. 

*There are inservlce activities in which more than one inservlce topic 
was covered. 



TABLE 24 

.Educators' Perception of Pertinence of Inservlce 
Activities to Basic Skills Instruction 
(N » Number of inservice activities) 



Perception 



Total Sample' 
N % 



District I 
N X 



District II 
N % 



District III 

' N % 



Teachers 

1. How pertinent was activity 
to helping you instruct 
students in basic skills 
of language, reading, and 
arithmetic? 

Very perjtinent 

Pertinent 

Not Pertinent 



74 


35X 


27 


U7X 


25 


34Z 


22 


27% 


67 


32Z 


17 


30% 


27 


37Z 


23 


■ 29% 


70 


33% 


13 


23% 


21 


29% 


36 


44% 



Administrators 

2. How pertinent was activity 
to helping teachers instruct 
students^in basic skills of 
language, reading, and 
arithmetic? 

Very pertinent 
Pertinent 6 
Not Pertinent 4 



58% 
25% 
17% 



5 83% 

0 'o% 

1* ift 



5 50% 
3 30% 
2 ' 20% 



4 
3 
1 



50% 
38% 
12% 



Note: Data source for item 1 is Appendix C,'item 4. 
2 is Appendix G, item 6., 



Data source for item 



8u 

73 



the finding of 76 percent stated in the above paragraph as the percentage of 
basic skills activities in Table 23. As shovm in Table 24, teachers also see 
that a high percentage of their activities are pertinent ot very pertinent to 
basic skills instruction (67 percent). This perci^ntage is much higher than 
the percentage of 37 percent (Table 20) derived from our content analysis. A 
likely explanation for this discrepancy is that teachers perceive that basic 
skills are embedded in and reinforced by other curriculum subjects. 

X ■ ' ■ 

' ■ m ■ 

Research Question 3 . ^ 

What form do current inservice activities take and how 

does this form compare with recommended practice? 

» ■ ' 

This research question was answered by comparing the descriptive data 

on teachers' inservice activities with the recoooiended practices listed in 

Table 3. The recommended practices were derived from a review of research on 

inservice education. These practices are organized into six major 

categories: teacher objectives, student objectives, delivery system, 

'organizational context, governance structure, and selection and evaluation. 

The following presentation of data is organized by the same categories. 

Xt* will be apparent that data are not available for some of the 
recommended practices listed in Table 3. This is because some of the 
practices had not been identified through a literature review at the time 
that the measures were designed. Also, some of the data relating to 
recommended practices are open-form responses to interview questions. They 
were not analyzed in time for this report. 

Teacher objectives. The first category of inservice practicies 
concerns teacher objectives. These objectives are the information, 
understandings, skills, and attitudes that teachers are expected to acquire 
as an outcome of participating in the inservice activity^ The literature 
review indicated that training in direct instruction strategies is an 
effective teacher objective if the eventual goal is to improve students' 
basic skill achievement. 

To determine whether such training occurred, teachers' descriptions 
of their inservice actj^vities over a year's time were analyzed t;o determine 
whether they included mention of training in direct instruction strategies. 
(Content analysis procedures are described in appendix I.) An activity was 
coded as inc:3.uding such training if the teacher referred to any of these 
direct instrxiction strategies: 

1. Monitoring behavior in which the teacher asks students 
to perform a desired basic skill, for example, 
workbook practice accompanied by teacher monitoring. 

2. Reactive-corrective behavior to help a student 
when he or she has failed to make the desired 
response. 

3. 'Increasing time allocated for basic skills 

instruction. 

t 

4. Increasing students' on task behavior during 
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basic skills Instruction, 

5. Talcing Into account students' prior 
learning. 

6. Increasing the overlap between Instructional 
content and achievement test content. 

The results of this analysis are shown In Table 25 (Item 1). Only 3 percent 
of the Inservlce activities Included mention that such training occurred; 
This 3 percent statistic Includes just 8 of the 279 Inservlce activities that 
were content-analyzed on this dimension. 

A similar content analysis was done on administrators' descrlptlans 
of the Inservlce activities that they sponsored or administered. Only 3 of 
the 28 activities (11 percent) Included mention of direct Instruction 
techniques. This percentage Is higher than the percentage reported by. 
teachers. 

' Teachers were asked In Interview Schedule II whether they had ever 
been trained In several of the techniques that comprise direct Instruction. 
Their response to these questions Is also shown In Table 25 (Items 2-4). A 
majority of the teachers stated that they had received training In techniques 
for keeping students on task at some point In their careers. A much smaller 
percentage of teachers stated that they had received- training In time 
allocation and Instruction/test content overlap. The large between-dltftrlct 
variation on these training objectives (for example, 0 percent on time 
allocation In district I, but 38 percent In district II) suggests that 
Individual districts .have made these objectives a priority ^^t some point In 
time. 

The literature rrfvlew Indicated that the teacher oMcctlves for an 
inservlce activity should be stated In operational form andsAlth explicit 
criteria for performance. The descrlptlvie data presented In Table 26 
Indicate that the majority of Inservlce activities had clear, operationally 
stated objectives. Less than half of the activities, however; presented 
criteria so that teachers would know when they had achieved an objective. 

Student objectives. Research findings Indicate that effective 
Inservlce progrwas for Improving students' basic skills achievement focus 
directly on this bbjectlve. Research question 2 addressed part of this 
student objective, namely, the prevaUnce of Inservlce activities that dfeal 
with basic skills. The research results relating to this question (see Table 
20) indicate that a bit more than one-third of Inservlce activities relate 
directly to basic skills, with substantial between^dlstrlct variation in 
emphasis on specific basic skill areas (see Table 21). Baslxi skills 
instruction doubtless also received additional attention in Inservlce 
activities classified as "general academic" (24 percent of the activities 
received this classification— see Table 20). Given the many facets of the 
elementary school curriculum, this amount of emphasis on the basic skills may 
be quite adequate. 

The other part of recommended practice is that inservlce activities 
should aim to Increase achievement of the basic skills. Teachers' 
descriptions of the student objectives for inservlce activities in which they 



TABLE 25 

Prevalence of Training in "Direct Instruction" Strategies 
In Current In^ervice Practice 



Total Sample District I District II District III 
Direct Instruction (DI) . N* Z N* % N* Z N* Z 



1. 



i 
2. 



3X 
97% 



Did last year's in- 
service include 
training in direct 
instruction? 

Yes 8 3% 4 4Z 2 2Z 2 

No 271 97Z 90 96Z 102 98Z 79 

Ever been trained 

in how to allocate 

more time for basic 

skills instruction? 

Yes 9 26Z 0 OX 5 38Z 4 36Z 

No 26 74Z 11 lOOZ 8 62Z 7 64Z 



Ever been trained 
in how to keep 
students on task 
during basic skidls^ 
instruction? 

Yes 
No 



21 
14 



60% 
40% 



6 
5 



54%- 
46% 



7 
6 



54% 
46% 



8 

3 



73% 
«7% 



Ever been trained 
in how to increase 
overlap between 
content of basic 
skills instruction 
and test content? . 

Yes 

No 



11 
24 



31% 
69% 



54% 
46% 



3 
10 



23% 
77% 



2 
9 



18% 
82% 



Note: Data source for item 1 is a content analysis of Appendix C, 
item 1. '■ . ' . 

Data source for items 2-4 is Appendix E, items 11, 14,' 
and 17, respectively.* 

*N 'f or^jjjJlg 1 is number of inservice activities. ,N for items 2-4 is 
number of teachers. 
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TABLE 26 

Prevalence of Effective Practices Relating to Objectives of 
Inservlce Education for Basic Skills Instruction 
(N "Number of Inservlce activities) 



Practice 



Total Sample District I District tl District III 
N Z NX NX N X 



1 . Operatlonallzatlon 

a. Were the Inservlce 
objectives clearly 
communicated? 
Yes 
No 



179 
34 



84Z 
16% 



61 74Z 
21 26Z 



67 9ZX 
6 8% 



51 88Z 
7 12Z 



b. Were' the Inservlce 
objectives clear 
to you? 

Clear 

Unclear 



176 
31 



84Z 
16Z 



65 80Z 
16 20% 



60 84% 
11 16% 



51 88% 
7 12% 



2. Measurement of Teacher Competence 
Were you given criteria for 
knowing when^jyou achieved a,n 
Inservlce objective? 

Yes 89 42% 

No 124 58% 



32 39% 
50 61% 



28 38% 
45 62% 



29 50% 
29 50% 



Note: Data source for Items la and 2 are Appendix C, items 3 and 4, 
respectively. Data source for Item lb is Appendix D, lte« 3. 



had participated were content-analyzed for mention of student achievement 
outcomes. Any mention of achievement tests , achievement test scores, or 
grades was. considered an Indicator of focus on student achievement. This 
variable was not limited to achievement of basic skills » but all of the 
inservlce activities that Included mention of achievement concerned basic 
skills or general academic performance. 

The results of the data analysis are shown in Table 27. Only 20 of 
the 279 inservlce activities made any mention of student achievement 
outcomes » and the majority of these activities were in 1 district. The 
"taters' impression of the teachers' descriptions was that the emphasis of 
inservlce activities was on improving the instructional process and student 
motivation for learning. There was very little emphasis on student 
achievement of basic skills as an outcome of inservlce activities. 

A similar content analysis was made of administrators' descriptions 
of the inservlce activities that they sponsored or administered. Only 2 of 
the 28 activities (7 percent) included mention of student achievement as an 
outcome of inservlce activities. 

Delivery system. This category refers to the design of the 
activities involved in the inservlce program. Two recommended inservlce 
practices are to include readiness activities and followup activities. The 
research results presented in Table 28 indicate that approximately one-third 
of the inservlce^ programs included readiness and followup activities. 

These results are consistent with the data presented in Tables 15 and 
1^. Twenty-eight percent of the inservlce programs (see Table 16) included 
more than one session, which would provide opportunity for readiness and/or 
followup activities to occur. Similarly, one--third of the programs (see 
Table 15) were 7 hours or more, which is sufficient time to include a 
readlnesF and/or followup activity 

Research on effective practices for jscheduling inservlce activities 
has yielded unclear rdisults. There is evidence that^ teachers prefer 
inservlce programs Xo occur during' school hours, but there is also evidence 
that effective inservlce programs are scheduled outside of sch9ol hours. The 
data pr^esented in Table 29 indicate that the majority of inservlce activities 
are scheduled during regular work hours (65Z) in the afternoon (50%). 
'One-fifth of the oactivities are scheduled outside of teachers' regular work, 
hours. 

Organizational p ontext . This category includes dimensions that 
reflect whether the inservlce activity is connected to the organization and 
work of the school system. The first item of Table 30 presents data on the 
extent to >rhich teachers perceive that" inservlce activities are directed 
toward school Improvement. 'Less than one-fifth of the activities were 
perceived as being for this purpose. The majority of the itiservice 
activities were perceived as being for personal professional improvements ^ 

* A content analysis of teachers' descriptions was done to determine 
the extent to which inservlce activities were tied to curriculum adoptions. 
A reliability check indicated that the two raters agreed on^ $6 percent of 
their classifications. All activities were double-coded, and disagreements 
were resolved by , discussion. One-third of the activities were rated as being 
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TABLE 27 , 
Teachers' Reference to Student Achievement Outcomes 
in Describing Inservice Activities 
(N -Number of insetvice activities) 



Total Sample District I District II District III 
'Practice ' N X N Z N Z N % 



Were student achievement 
outcomes mentioned^in ^ 
describing th^ inservice 
activity? 

■ ' Yes 
No ^ 



20 7% 13 14% 2 2% 5 6% 

259 93% 81 86% 102 98% 76 94% 



Note: Data source was a content analysis of Appendix C, 
items 1 and 8* 



\ - 

\ 



\ 



6(, 
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TABLE 238 , 

Prevalence of Effective Training Procedures In 
Current Inservlce Practice 
(N %Number of Inservlce activities) 



Practice Total Sample District I District H District III 

NZ n;: n% nz 



1. Readiness Activities 



.7 



Did you/i>articlpate in 

readiness activities / 
prior to the inservlce? 

Yes , 69 32Z 21 26Z 29 40Z 19 33Z 

No^ 144 68Z 61 74Z 44 60Z 39 67Z 



2. Followup Training 

Any followup Activities ^ 
to help you maintain or , 

increase what you ^ 
learned initially? <^ 

Yes ^78^37% 28 34Z 20 27Z 28 48Z 

No 135 63Z 54 66Z 53 ^73Z 30 52Z 

. • ' * 

3> Ct^ecking for Application 

Did anyone check to see , 

If you We're applying 

what you learned? 

Yes 51 24Z. 22 27Z 9 13Z 20 35Z 

Nq 158 76Z 60 73Z 60 87Z 38 65Z 



Note: Data source for items i-3 is Appendix '^C, items 12, 14a, and 14b, " 
respectively. - 



TABLE 29 

Times of Day and Year for Scheduling Inservice Activities 
(N » Number of inservice activities) 



Total Sample District I District II DistriEct IH 
Scheduling N X N % N % N U 



Time of day 
Morning 
Afternoon 
Evening 
All day 



2. Percentage of 

scheduling during 
regular work hours* 
0% 

>0Z<100% 
V lOOZ 



lA 


7Z 


3 


A% 


5 


7X 


6 


10% 


106 


50Z 


57% 


70% 


30 


43% 


19 


33% 


17 


8Z 


10 


12% 


3 


4% 


4 


7% 


73 


35% 


12 


14% 


32 


46% 


29 


50% 



47 


22% 


17 


21% 


15 


21% 


15 


26% 


28 


13% 


. 10 


12% 


14 


.19% 


4 


7% 


138 


65% 


- 35 


67% 


44 


60% 


39 


67% 



Note; Data source for items 1 and 2 is Appendix C, item 18. 

*The mean and standard deviation (in parenthesels) of percentage 
scheduled is: for total sample, 72.58 (41. A5); for district I, 
74.00 (40.86); for district. II, 72.25 (40.54); and for district 
III, 71.00 (44.01). 
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TABLK 30 

Prc'valfnce of Effective Practices Relating to Organizational 
Context of Ihservice Education 
(N » Ntmber of inservice activities) 



ERIC 





Practice 


Total Sample 


District I 


District II 


District 






N. 


% 


N 


X 




N 


X 


N 


% 


1. 


Purpose for Participation: 




















To improve myself 






















professionally 


124 


64Z 


48 


62% 


43 


72% 


33 


59% 




To help improve my 






















school 


22 


IIZ 


8 


lOZ 


8 


13% 


6 


11% 




To help improve my 






















school district 


14 


7Z 


9 


12% 


[ 2 


3% 


3 


5% 


























requirements 


6 


3Z 


2 




% 


3 


5% 


1 


2% 




Other 


27 


14Z 


10 


\ 




4 


7% 


13- 


23% 


2. 


Were curriculum or 






















other changes related 




















it 


U lie X'lOCLVXV.C 






















being made? 






















Yes 


89 


42Z 


39 


48% 


28 


38% 


22 


38% 




No 


124 


58Z ' 


•43 


52% 


45 


62% 


36 


62% 


3, 


Was the- activity 






















tied to a curriculum 






















oaupLXUIl Xil L lie 






















district? 






















Ves 


93 


33Z 


39 


42% 


17 


16% 


37 


46% 




No 


186 


67Z 


55 


58% 


28 


84% 


44 


54% 


A 


I did the inservice 






















activity: 






















By myself 






















Yes 


69 


33Z 


28 


35% * 


18 


25% 


23 


40% 




No 


143 


67Z 


53 


65% • 


55 


75% , 


35 


60% 


5. 


I did the inservice 






















activity: 






















With ather teachers 






















from my school. 
















41 






Yes 


168 


79Z 


69 


-85% 


58 


80% 


71% 




No 


44 


21Z 


12 


15% 


15' 


20% 


17 


29% 


6. 


I did the inservice 






















activity: 






















With other teachers 






















from different 
















♦ 






schools in my. 






















district. 






















Yes ■■■ 


138 


65X 


67 


83Jr 


35 . 


48% • 


36 


62% 




No 




35% 




17% 


38 


52% 


22 


38% 























92 



TABLE 30 
(Continued) 





rtoCCICe 


Total 
N 


SaniD 1 e 
X 


District I 
N % 


District II 
N % 


District ill 

N % 


7. 


Was your principal 
invoxveu xn uue 




















inservice? 

Yes 
No 


139 
74 


65Z 
35% 


48 
34 


59% 
42% 


45 
' 28 


62% 
38% 


46 
12 


79% 
21% 


8. 


Were school district 




















administrators 




















involved? 

Yes 
No 


112 
99 


53% 
47% 


53 
29 


65% 
35% 


32 
41 


44% 
56% 


27 
29 


48% 
52% 



♦Note: Data source for Items 1, 2, 7, and 8 Is Appendix C, Items 20, 
22d, 22a, and 22c, respectively. Data source for Items 4-6 
Is Appendix D, Item 21a. Data source for Item 3 was a content 
analysis of Appendix C, item 1. 
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tted to a curriculum adoption (Table 30, Item 3). 'A related question in one 
of the interview schedules aaked whether the Inservlce activity was 
accosipanieid by a change in curriculum or in some othei: aspect of school^g. 
As exi>ected» this itiem yielded a higher percentage of inservlce activities 
that accompanied a change process in the school or district (Table 30, item 
2). Curiously, though, the percentage of currlculum/other-related activities 
for district 111 was lower tL&n the percentage for curriculum-adoption 
inservlce activities. * 

One might imagine that teachers would consider curriculum adoption to 
be a school improvement function. The data indicate, however, that 33 
percent of the inservlce activities were tied to curriculum adoptions, but 
only 18 percent of the activities were perceived as directecj/' toward school or 
district improvement. Perhaps soise teachers perceive that curriculum 
adoptions are a school maintenance function rathe^ than an improvement 
function. 

Principals' and assistant superintendents' descriptions of the 
inservlce activities that they sponsored or administered were also content 
analysed for mention of curriculum adoption or change. The content analysis 
involved administrators' responses to items 1 and 5 of Interview Schedule I, 
Part Two (Appendix G). Thirteen of the 28 inservlce activities (46 percent) 
made reference to curriculum adoption or change. 

Table 30 indicates that approximately 80 percent of the inservlce ^ 
activities (see item 5) involved more than one teacher from the same school. 
A smaller percentage of activities, but still a majority (65 percent — see 
item 7) involved the teachers" building principals. It is also the case that 
a majority of inservlce activities involve teachers from different schools in 
a district (65 percent — see item 6) and school district administrators (53 
percent — see item 8). These findings suggest th^t currrent inservlce 
practice is designed to be administered to schools and districts as 
organizational units. This organizational arrangement should facilitate 
inservlce for school or district improvement, yet It Is not often used for 
this purpose, as was indicated aboves 

Governance Structure. This category refers to practices Involved in 
administering and managing inservlce activities^ A key administrative 
decision is whether to require teacher participation in an inservlce program 
or to allow voluntary participation. The results shown in Table 31 (item 1) 
indicate that the use of required and voluntary paxticipatlon 'is equally 
prevalent in current practice. There is little basis in previous research 
for determining whether voluntary or mandatory participation is more 
effective, but it would seem that mandatory partijCipatlon would-be a 
necessary condition for schoolwide or districtwide improvement of 
instruction. 

Another practice available for administering inservlce activities is 
to use incentives and sanctions to motivate teacher participatlolT. The 
current prevalence of incentives and sanctions Is shown In Table 31. 
Incentives were used in approximately one-half of the activities, and 
sanctions were used in Just one-fourth of the activities. 

The sponsors of Inservlce activities can bear the costs associated 
with the inservlce activity or require teachers to pa^ some or all of £he 



TABLE 31 

Prevalence of Effective Practices Relating to 
Governance of Inservice Education 
(N » Number of inservice activities) 





Total Sample 


District I 


District II 


District III 


Practice 


N 






y 


N 


r 


N 


z 


1. Type of Participation 














f 


My involvement in this 


















inservice was: 












59% 


31 


53% 


Voluntary 


104 


49Z 


30 


37% 


43 


Required 


102 


48Z 


50 


62% 


27 


37% 


25 


43% 


Not required, 


















but felt pressure 










4% 




'4% 


to participate 


6 




1 


12 


3 


2 


2. Incentives 


















Any incentives for 


















participation in this 


















activity? 












63% 


51 


88% 


Yes 


116 


55% 


20 


24% 


45 


No 


96 






762 


27 


37% 


7 


12% 


3. Sanctions 


















Any negative conse- 


















quences for not 


















participating, for 


















poor performance! 


















or for non-imple- - 


















mentation? 










26 


36% 




15% 


V ' Yes 


53 


25% 


IB 


22% 


9 


No 


159 


75% 


64 


78% 


46 


64% 


49 


85% 


4. Costs 


















Any out-of-pocket 


















costs to parti- 


















cipate? 

Yes 


47 


22% 


14 


17% 


25 


35% 


8 


14% 


No 


163 


78% 


68 


83% 


46 


65% 


49 


86% 



Note: Data source for Itenf 1 Is Appendix D, Item 25. 

Data source for Items 2, 3, and 4 Is Appendix C, Items 
25, 26» and 19,. respectively. 
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costs. As shown in Table 31, the sponsor bore the costd of almost 80 percent 
of teachers' inservlce activities. Content analysis of interview data on 
governance structure has not been done yet, but it appears that the great 
majoirity of teachers' inservice activities are sponsored by the school 
district. The costs associated with the activities, then, are largely paid 
by the district. For those activities that involved out-of-pocket ^expenses , 
the median cost for the total sample and for each district was approximately 
$25. The range of costs was from $2 to $1000. Only 4 percent of the 
activities involving out-of-pocket expenses had costt, of $100 or more. 

Several between-district variations in results shown in Table 31 are 
worthy of note. Relative to the other districts, district I had a high rate 
of required inservice activities but a low rate of incentives for 
participation. District II had the highest rate of voluntary inservice 
activities, but also the highest rate of sanctions for non-participation and 
the highest rate o{ activities with out-of-pocket expen36s. 

Selection and evaluation. This category refers to procedures for 
selecting and evaluating inservice activities. Table 32 presents data 
analyses relating to current practices in these aspects of inservice 
education. Teachers report that, only 12 percent of the activities were 
selected as a result of a formal needs assessment (item lb). Also, it 
appears that teachers were seldom asked (10 percent of the time) whether they 
needed the training provided by the inservice activity (item la). Despite 
the low incidence of needs assessment to select activities, most of them (88 
percent) were perceived as relevant to the teachers' work (item 2a). 

A key feature of research on basic skills instruction has been the 
use of achievement tests to evaluate students' progress and to evaluate the 
effectiveness of inservice programs. The data analysis shown In Table 32 
(item 3a) reveals that only 6 percent of the activities involved assessment 
of students fot any type of outcome to determine the effectiveness of the 
inservice activities. Ot activities in this group, just a small number 
included an expectation of how much student change or gain might result from 
the inservice Activity. 

The data analysis reported in item 3a of Table 32 Is consistent with 
the data analysis reported in Table 27. As shown in the latter table. Just 7 
percent of teachers' descriptions of inservice activities made reference to' 
student achievement outcomes as *an objective of an activity. Similarly, 
Table 32 reports that Just 6 percent of the activities included assessment of 
student improvement. 



Research Question 4 
How effective and satisfying is current inservice 
^ education as perceived by educators? 

* 

Teachers completed e rating form (Appendix D) for each inservice 
activity described in Interview Schedule I, Part Two (Appendix C). Teachers' 
responses to this rating form provided the data base for most of the analyses 
that were done to answer the research question stated above. 

Table 33 reports data analyses for several measures of teacher « 
satisfaction with the effects of Inservice activities on their performance. 



TABLE 32 

Prevalence of Effective Practices Relating to 
Selection and Evaluation of Inservice )Education 



prac .>a Total Sample District I District II District III 



1 . Needs Assessment ^ . 

a. Were you asked whether 
you needed the 

inservice? * o i/^ 

Yes 21. 10% 8 10% 5 7%> ' 8 14% 

^^o 192 90% 74 90% 68 93% 50 86% 

b. Was this inservice 



selected by a formal 
needs assessment? 

Xes 

No 



'24 12%f 13 16% 5 7% 8 14% 

173 88% 66 84% 68 93% 50 86% 



2m Relevance 



Did the inservice 
pertain to your 
work as a teacher? 

Yes 

No 



187^ .88% 70 85% 64 88% 53 91% 

26 12% 12 15% 9 12% 5 9% 



3 . Measurement of' Student Objectives 

a. Were students assessed " 
• for improvement or 

change as a result 

of your participation 

in the inservice? 

Yes 13 6% • 4 5% 5 7% 4 7% 

No 200 94% 78 95% 68 93% 54 93% 

b. If "Yes** to 3a, above,, 
were you given an ~ 
expectation about how 
much of a gain or 

change in students 

would result?* • , 

Yes 4 27% 2 50% 1 20% 1 l7% 



No 



11 73% 2 50% 4 80% ' 5 83% 



T^te: Data source for items 1, 2a, 3a, and 3b is Appendix C, items 7, 
16, 9, and 10, respectively. 



*Por two inservice activities, the teacher indicated a "No" response to 
item ,3a in the table, but answered the next question (item 3b in the table) 



anyway • 



TABLE 33 

Teachers' Degree of Satisfaction with Effects of Inservice 
Activities on Their Performance 
(N Number of insetvlce activities) 



Effect 


Total 


Sample 


District I 


District II 


District II 




N 


% 


N 


% 


N 


% 


N 


% 






O 














1. Effects of the 


















inservice on my 


















competence as a 


















teacher. 


• 
















Positive effects 


157 


75% 


57 


71% 


53 


84% 


47 


81% ' 


Negative effects 


5 


2% 


2 


3% 


2 


3% 


1 


2% 


None 




23% 


21 


26% 


17 


23% 


10 


17% 


2. Sideref fects of the 


















inservice on me. 


















Positive effects 




68% " 


53 


68% 


50 


68% 


40 


69% 


Nega€ive effects 


35 


17% 


14 


18% 


13 ' 


18% 


8 


14% 


None 


31 


15% 


11 


14% 


10 ' 


14% 


10 


17% 


3. Long-term. effects 


















of the inservice 


















on me. 


















Positive effects 


161 


79% 


59 


76% 


52 


76% 


50 


88% 


• Negative effects 


22 


11% 


8 


10% 


12 


17% 


2 


3% 


None * 


21 


10% 


11 


14% 


5 




5 




Note: Data source for 


items 1, 


2, and 


3 is Appendix D, 


items 27, 







2a, and 2b, respectively. 



\ 



A very low Incidence of negative effects on teacher competence (2 percent) 
was noted. It Is surprising, though, that teachers ceported negative 
side-effects for 17 percent of the activities and negative long-term effects 
for 11 percent of the activities. Overall teachers felt that approximately 
75 percent of the activities had positive effects on their professional 
performance. 

Teachers' satisfaction with the content' of inservice activities is 
shown In Table 34. More than 80 percent of the activities were satisfactory 
in this respect (items 1 and 2). A remarkable finding, though, is that 
teachers felt that they had adequate mastery of the content of 63 percent of 
the inservice activities beforehand. This finding suggests that teachers 
were generally satisfied with inservice content for reasons other than that 
it filled gaps in their knowledge, skills, or attitudes. 

Research results relating to teachers' satisfaction with effects of 
inservice activities on their students' performance are shown in Table 35. 
Where student effects were noted, they were generally positive. A 
substantial percentage of inservice activities (34 percent), however, 
produced no cognitive or affective effects. 

Table 36 presents data analyses relating to teachers' satisfaction 
with the various dimensions of inservice delivery systems. Teacher 
sablstaction level was generally high. Where dissatisf ac^on occurred, it 
was selective across dimensions. There was low dissatisfatetion with 
.readiness activities, training sites, and costs. Higher levels of 
dissatisfaction were reported f<rr learning process (19 percent of the 
activities) and inffervice trainer (16 percent of the activities). There was 
relatively little variation in satisfaction levels across districts. 

Teachers' degree of satisfaction with the organizational context of • 
inservice activities is reported in Table 37. Teachers generally were quite 
satisfied with the involvement of other teachers, principals, and district 
administrators in their inservice activities. Their degree of satisfaction 
with other teacher participants was especially high. 

Teachers'" degree of satisfaction with several aspects of inservice 
governance is reported in Table 38. Teachers expressed a moderate amount of 
dissatisfaction with inservice policy-malting, including their involveipent in 
the selection and design of the activities. They expressed less 
dissatisfaction with the incentives associated with inservice activities. 

The interview schedules included only a Single item concerplng 
teachers' satisfaction with the evaluation of inservice activities. Results 
for this item are reported in Table 391.. Teachers are generally satisfied 
with the way that student effects associated with the inservice activities 
were measured. The validity of these data is doubtful, however. The^total 
sample reported satisfaction or dissatisfaction with 79 of the activities. 
The sample also reported that only 13 activities included assessment of 
student improvement or change (Table 32, item 3a). The difference in 
frequencies is probably dqe to the ^biguity in the wording of ttje l,tem that 
provided the data base for Table 39. 

Summary. The results presented above indicate that teachers are 
generally satisfied with the butcomes and processes of their Inservice 
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/ TABLE 3A . '^^ . r 

Teachers' Degree, of Satisfaction Wvith the Content 
of Inservice Activities 
(N ^ Number of inservice activities) 



Content 



Total Sample District I District II District III 



1 » QaflQfarf4nn u1 fh 
















0 

* 


WnelL X Woo oUppuocU 


















to learn from the 


















activity. 


















Satisfied 


179 


85Z 


.66 


8^ 


60 


85% 


53 


91% 


Dissatisfied 


32 


15Z ^ 


' 16 


19Z 


11 


15% 

* 


5: 


9% 


2. Satisfied with 






*. 












relevance of 


















inservice 


















content. * 


















Satisfied 


176 


82% 


63 


77Z 


60 


82% 


53 


91% 


Dissatisfied 


33 


16Z 


18 


22Z 


10 


14% 


"5 


9% 


3. Prior to the .inservice 


> 














t 


my knowledge/skill/ 


















attitude relating to 


















the inserVice was: 


















flore than adequate 


29 


14Z 


11 


14Z 


10 


14% 


8 


14% 


Adequate 


103 


49Z 


.39 


49Z 


38 


52% 


26 


45% 


Less thah adequate 


79 


37i 


30 


37Z 


25 


34% 


24 


41% 



Note: Data source for Items 1, 2, and 3 is Appendix^ D, Items 1, 
16, and 28c, respectively. 
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TABLE 35 ^ 
Teachers' ^Degree of Satisfaction with Effects of 
Inservice Activities on Their Students' Performance 
(N = Number of insetvice activities) 



Effect . 



Total Sample District I Dls*:rict 11- , District III 
n' % % N % . % 



1. Satisfaction with 
intended effects of 
the inservice on my 
student^. 

Satisfied 
Dissatisfied 
Not Applicable 

2. Side-effects of the 
inservice on my 
students were: , 

■ Positive 
Negative 
None 

3. Long-term effects of 
.the inservice on my 
students were: 

Positive 
Negative 
None 



156 73% 
24 11% 
33 1^% 



130' 62% 
8 4% 
70 34% 



141 69% 
6 3% 
58 28% 



60 73% 
14 .17% 
8 10% 



51 64% 
4 5% 
25 31% 



48 61% 
4 5% 
27 34% 



50 
5 
18 



A3 
2 
26 



50 
1 

20 



68% 
25% 



6-1% 
36% • 



71% 
1% 
28% 



46 79% 
5 9% 
7 12% 



36 63% 
2 .4% 
19 33% 



43 78% 
1 ■ 2% 
11 20% 



4.' The effect of the 
. inservice on stu- 
dents' cognitive 
growth was: 
Positive 
Negative 
No effects 



137. 66% 
0 0% 
71 34% 



48 60% 
0 0%. 
32 40% 



44 • 63% 
0 0% 
26 37% 



45 78% 
0 0% 
13 22% 



The effect of the 
inservice on stu- 
dents' affective 
growth was: 

Positive 

Negative « 

No effects 



136 65% 
1 1% 
■71 34% 



49 61% 
■ 0 0% 
31 39% 



44 63% 
40 " 0% 
^6 37% 



43 74% 
1 2% 
14 24% 



Note: Data source for items 1. 2, 3, 4, and 5 is Ap^enaix D, items 
. • 8, 9a, 9b, 28a, and 28b, respectively. 
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TABLE 36 

Teachers' Degree pf Satisfaction with the Delivery System 
Used in Inservice Activities 
^ (N * Number of inservice ^activities) 



Delivery System Practice Total Sample District I District II District III 









% 


N 


% 


N 


% 


N 


% 




Readiness Activities 








> 


1* 










Satisfied 


105 


49Z ' 


43 


52% 


33 


45% 


29 


50% 




Dissatisfied 


19 


9Z 


7 


9% 


5 


7% 


7 


12% 




Not appl i cable 


89 


42Z 


32 


39% 


35 


48% 


22 


38% 


• 


\ 




















, Satisfied 


168 


73Z 


62 


77% 


57 


78% 


49 


85% 




Dissatisfied 


41 


19% 


17 


21% 


15 


21% 


9 


,15% 


• 


Not applicable 


3 


2% 


2 * 


^2% 


1 


1% 


0 


0% 


3. 


Followup Activities 




















Satisfied 


81 


38% 


36 


44% * 


18 


25% 




47% 




Dissatii^>f ied 


24 


11% 


13 


16% 


5 


7% 




10% 




Not applicable 


107 


51% 


33 


40% 


49 


68% 


25 


43% 


,4. 


Training Site 




















Satisfied 


197 


93% 


78 


95% • 


62 


85% 


57 


-98% 




Dissatisfied 


14 


6% 


3 


4% 


10 


'14% 


1 


2% 




^ Not aDolicable 


• 2 


1% 


1 


1% 


1 


1% 


0 


0% 


f 




















Inservice Trainer 




















Satisfied 


172 


82% 


. 68 


83% 


53 


76% 


51 


88% 




Dissatisfied 


34 


16% 


12 


15% 


16 


23% 




10% 




Not applicable 


4 


2% 


2 


2% 


1 


1% 


1 


.2% 




Scheduling 




















Satiafied 


181 


85% 


72 


88% 


61 


83% 


48, 


83% 




Dissatisfied 


25 


12% 


7 


8% 


10 


14% 


8 


14% 




Not applicable 


7 


3% 


3 




2 


. 3% 


2 


3% 


7^ 


Cost 




















Satisfied I 


'l28 


60% 


51 


62% 


37 


51% 


40 


69»- 




Dissatisfied 


11 


^ 5% - 


1 


1% 


8 


11 


2 


'3% 




l9ot applicable 


74 


35% 


30 


37% 


28 


38% 


16 


28% 



Note: Data source for items 1-7 is Appendix D; items 12» 13, 14, 15; 17, 
18, and 19, respectively • 



TABLE 37 

Teachers' Degree of Satisfaction with the Organizational 
Context of Inservice Activities 
' (N = Nitaber of inseifelce activities) 



organizational Context Total Sample District I District 11 District III^ 
Practice . N % N Z N % N %. 

1. Satisfaction with - * 

teachei^s who parti- > " . 

cipated in the In- • - ' . - 

, service .with me. « r^zw ci qqj 

Satisfied 189 89Z: . 7a 85% 39 95Z 5 88? • 

Dissatisfied 6 37. A 5% » 1 , IZ 1 2Z 



Not applicable 17 



82 8 107. 3 4% I 6 10% 



2. Satisfaction with my ' ^ ^ 
principal's involvement 

in the inservice. - 

, satisfied 111 53Z A3 52% • 27 37% «il 71% 

Dissatisfied , 20' 9% . 10 12% 10 1A% 0 0% 

Not applicable 81 38% 29 36% , 35 A9Z 17 29Z 

\ 

3. Satisfaction with the • 
s^chool district/central 

office administrator's ' " 4. 
involvement in the ^ 

^'^^-rtlsfied 101 A8% . A9-^60% 28 A0% -,2A Al| 

. Dissatisfied 20 9% 7 8Z 8 11% . 5 9% 

Not applicable 90 A3% 26 ^ 32% 35 A9Z 29 50% 



Note: Data sources for items 1-3 is Appendix D, items 21a, b, and c, 
respectively. ^ , 
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TABLE 38 

Teachers^ Degree of Satisfaction with the Governance 
of Inservice Activities 



Governance Practice 



Total Sample District 1 District 11 District 111 











M 


y 






» w 




1. 


> 

Satisfaction with ^he 




« 




































up UIIXo LX V X*L jr • ^ 






















124 




t / 




41 






fill 




UXooClLXoXXtSU 


JL\J 




X ^ 


1 St 




X Om 


K 
J 








'58 






97X 


1 Q 

X 7 




X / 




2.' 


Teachers' satisfaction 




* 










• 






with their involvement 




















in selection ana desiffn 








i 












i>f the inservfce 




















activity. 




















' Satisfied 


96 




29 


36% 


38 


53% 


29 


50% 




Dissatisfied 


29 


14Z 


I4« 


17% 


10 


14% 


5 


9% 




No opinion 


86 , 




38 


47% 




33% 


24. 


41% 


3. 


Satisfaction with 




















incentives associated 




















with this activity. 


133 


















Satisfied 


64Z 


■ 39 


49Z 


47 


66% 


47 


81% 




Dissatisfied 


17 


8Z 


8 


'lOZ 


6 


8% 


3 


5% 




No opinion 


59 


28% 


33 


41%. - 


18 


26% 


8 


14% 























Note: l)ata source for items 1, 2, and 3 is Appendix items *239 24, 
and 26, respectively. 
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^ * ' TABLE 39 . ' 

' Teachers' Degree of Satisfaction with the Evaluation- 
- of Inservic? Activities^ 



. Total Sample District t District II District III 



Evaluation Practice N 



% . N •% \ N % N % 



Satisf^tion with the 

that student effects ' 
associated with the . , 

activity were ^ 
measured. 

satisfied ^ - 71 34% 26 32% 27 3a% 18 32% 
Dissatisfied 8 4% 4 5% 1 1% • 3 5% 



Not applicable 129 



62% 51 63% 43 61% 35 63% 



Note:^ Data source- for this table is Appendix D, item 10. 
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activities. No more than 19 percent of the activities were considered 
unsatisfactory on any of the dimensions that were measured. Teachers 
expressed '^greatest satisfaction with the effects of the Inservlce activities 
on their competence,' with the intei^ded 'effects on their students, with the 
training site, and with other teacheili participating in the activities. They 
expressed m^erate dissatlsfactioa with the relevance of the inservlce 
content » with the learning processes used in the activities, with Inservlce 
policy making, and, with the trainer. .Teachers in district III generally 
expressed more satisfaction and less dissatisfaction than the teachers in the 
other two districts* ■ \ , . 

Teachers' JLevel of , satisfaction with their inservlce activities over 
the past year is mlx:rored.ln their overall attitude toward inservlce 
education. As showh in Table 40, only two teachers expressed a negative 
attitude toward Inservlce. education. All nine of the principals and 
assistant superintendents in the administrator sample indicated a positive 
attitude toward inservlce education for teachers. 



Research Question 5 
^ In the opinion of educators^ what constitutes an effective Inservlce 
program for Improving teachers' ,^.aslc skills Instruction? 

Teachers and administrators were ^sked their opinion of various 
inservlce practices identified as effective by researchers. Emphasis was 
placed on 'inservlce practices' that have been demonstrated^ to lead to 
Improvement's in students' basic skills achievement. Teachers' opinions ve re 
solicited in Teacher Interview Schedule II (Appendix E).. The opinions of 
^principals and assistant superintendents were solicited Xn Administrator 
.Interview Schedule II (Appendix H). The data analyses presented here are 
organized using the dimensions presented in Table 3. These dimensions are 
grouped under six major headings: teacher.* objectives, jstudent objectives, 
delivery system, organizational context, governance, ^nd 
s e lec t ion/ e va lua t ion . 

Also, the results are. reported for each group of educators (teachers, 
.principals, and assistant superintendents) rather than by district. The^ 
reason for reporting the data in. this form is t*hat our ioain Interest was in 
whether educators in different roles have different opinions about. how 
Inservlce programs should be conitltuted. 

Table 4l presents the sample's opinion about teacher competencies 
(dimension 1 In Table 3) that have been found effective in improving 
students' basic skills achievement. It appears that most teachers and 
adqilnlstrators believe that these competencies are effective. 

The next analysis concerned educators' beliefs about the Importance 
of basic skills instruction. The results of this analysis are presented in 
Table 42. Most teachers and administrators believe that basic skills 
instruction is critically Important. A.*mlndrlty of teachers and « 
^admldlstrators, however, do not think that basic skills' instruction is more 
important than other curriculum goals.. 

' Table 43 presents the sample's opinibns about what type of delivery 
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TABLE 40 

Educators' Attitude Towa^rd Inservice Activitie 
(N » Number of educators) 



Attitude 



Total Sample District I District II District III 
N % N XfN %. N % 



1. (Teachers) Attitude 
toward activities. 

Positive 

Neutral 

Negative 

2. (Administrators) 
Attitude toward 
inservice education 
for teachers 

Positive 

Neutral 

Negative 



29 
3 
2 



85% 
9% 
6% 



100% 



2 
1 



70% 
20% 
10% 



3 100% 



10 
1 
0 



91% 
9% 
0% 



2 100% 



12 92% 
0 0% 
r 8% 



.3 100% 



Note: Data source for item 1 is Appendix B, item 10. 

Data source for item 2 is Appendix F, item 10. 
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TABLE 41 

Teacher and A4mlnl8trator Beliefs About Efficacy of Direct Instruction 
Techniques In Improving Basic Skills Achievement 
' (N - Number of Educators) 



Techniques for Improving Students' 
Ba^fc Skills Achievement (BSA) 



Assistant 

Teachers Principals Superintendents 



1. Do you believe that allocating 
more time for basic skills in- 
struction is an effective 
technique for improving BSA? 

Effective 23 70% 

Not Effective 10 30% 



2. Do you believe that BSA would ^ 
improve if students stayed on 

task more often? 

Yes 35 100% 

No 0 0% 

3. Do you believe that BSA would * 
improve if teachers focus 

their instruction on the 

content covered on the tests? 

Yes' ' 31 94% 

No 2 6% 

4. Do you believe tha*: math BSA 
would improve if teachers used 
Good and Grouws' 'approach to 
teaching math? - 

' Yes 28 
No 5 

, i ■ 



85% 
15% 



5 
1 



6 100% 
0 0% 



83% 
17% 



6 100% 
'0 0% 



6 100% 
0 0%' 



'4 

3- 100% 
0' 0% 



2 ' 67% 
. 1 33% 



3 100% 
0 0% 



3 100% 
,0 0% 



Note: Data source for teachers' responses tq items 1, 2, 3, and 4 is 
Appendix E, items >, 12, 15, and 18, ^respectively. Data source 
for administrators' responses to items 1, 2, 3, and 4 is Appendix 
** H, items 9, 11, 13, and 16, respectively. 



TABLE 42 ' 
- . Teacher and Administrator Beliefs About the Importance 
of Basic Skills As a Curriculum, Objective 
(N * Number of Administrators) 



^ Assistant 

Teachers Principals Superintendent^ 
N Z N Z N Z 



1« How important is i.t for teachers 
to teach the basic skills? 

Critical ' 
Important 

Slightly Important' 
Unnecessary 



33 9AZ 5 83% 3 100% 

2 6Z 1 17% 



2* How important is it for teachers 

to teach the basic skills relative . ^ 

^ to other curriculum goals? « . ' o inny 

More Important^ 25 71% 4 67% 3 100% 

^E^lly Important 10 29% 2 33%. 

Less Important - * 



TABLE 43 

Educator Preferences Concerning the Delivery of Inservlce 
Education on Basic Skills Instruction <r 
(N • Number of educators) 



Feature of Delivery System 



Assistant 

Teachers Principals Superintendents 
N Z N Z N Z 



1 



T 



1. If you were Involved In the Good^ 
and Grouws' Inservlce program, 
would you want training to start 
right away? 

Start training right away ' 
. First have sessions to 
addtess persohal concerns 

2a; (Teachers) How would you feel 
about practicing new teaching 
skills while having someone 
observe you and give you 
feedback? 

Positive 

Negative 

2b, (Principals) How.woHid you 
feel about observing teachers 
and giving them feedback on 
their teaching skUls? 
, Positive 

Negative * - 

2c. (Central 6fflce) How would you 
feel about principals perform-* 
Ing functions described In 2b? 
Positive 
^ Negative 

3. Do you prefar an inservlce oh 
basic skills instr^iction to (a) 
occur^ all at. once, or (b) begin 
vith Initial training and be 
followed at Intervals with 
further training and refresher 
experiences f ' ' 

All at once 

At' Intervals 



11 
22 



33Z 
67Z 



0 
6 



OX 
IQOX 



0,, OX 
3 lOOZ 



31 
4 



89Z 



.6 lOOZ 

0 oz 



3 lOOZ 
0 OZ 



3 
31 



9X 
91% 



1 
5 



17Z 
83Z 



0> OZ 
3 lOOZ 




^Vy. 100 



/ TABLE 43 

(Continued)^ 



Feature of Delivery System 



Assistant 

Teachers Prl^ncipals Superintendents 
N Z N Z N Z 

I — 



4. Vfhere vi^ld you prefer inservice 
sessions on basic skills instruc- 
tion to be held? (More than 1 
response allowed.) ^ 

At teacher's school 

At school district offices' 

At a university 

Other 

It doesn't matter 

« 

5. ' Whom would you most prefer to 

conduct an inservice program on 
a new approach for teaching the 
* basic skills? 
A teacher 
' A district spercialist 
A professor 
Other 

^ ' No preference 

6. How accet>tab3Le is eacH. of these 
times Idr holding inseryice 
meetings? 

- a. Early in the morning before . 
class^es. 

Acceptable 
Unacceptable 



23 


66Z* 


4 


67Z* 


2 


67Z* 


12 


34Z. 


3 


50Z 


0 


OZ 


7 . 


20Z 


1 


17Z 


1 


33Z 


4 


IIZ 


0 


OZ 


1 


33Z 


• 9 


26Z 


1 


111 


0 


OZ 



13 


37Z 


0 


OZ 


2 


67Z 


3 


9Z 


1 


17Z 


0 


OZ 


5 " 


14Z 


0 


OZ 


0 


OZ 


6 


17Z 


1 


17Z ■ 


0 


OZ 


8 


23Z 


4 


66Z 


1 


33Z 



4 
31 



b. During regular j^chool hours 
(assuming a satisfactory 
replacement i-s found) 

Acceptable . 
Unaccc{)table 

c. In the 'afternoon after school. 

Acceptable 
Unacceptable 

d. In the evening after school. 

Acceptable 
Unacceptable 



34 
1 



22 
13 



15 
20 



IIZ 
89Z 



97Z 
3Z 



63Z 
37Z 



43Z 
57Z 



6 

0 



,4 

2 



3 
2 



17Z 
83Z 



lOOZ 
OZ 



67Z 
33Z 



60Z 
40Z 



3 lOOZ 
0 OZ 



2 
1 



1 
2 



67Z 
33Z 



3 lOOZ 
0 t)Z 



33Z 
67Z 



lai 



TABLE 43 
(Continued) 



Fea^ture of Delivery System 



Assistant 

Teachers Principals Superintendents 
N Z N Z H X 



On Imservlce days when no 
classes are scheduled'. 

Acceptable 

Unacceptable 



32 
3 



91Z 
9% 



g. Just before the start of 
the school year. 

Acceptable 
Unacceptable 

h. During the summer. 

Acceptable 
, Unacceptable 



29 
6 



83% 
17% 



6 100% 
0 0% 



Weekends during school year. - ' 

Acceptable 8 24% 1 17% 

Unacceptable 26 76% 5 83% 



5 
1 




83% 
17% 



67% 
33% 



3 100% 
0 0% 



1 
2 



2 
1 



33% 
67% 



^3 100% 
0 0% 



67% 
33% 



Note: Data source^! fqr teachers' responses to Items 1.,- 2a7~~3) .4^| 5, and 6 
Is Ap)>endlx E, Items 21, 23, 25,^26, 2], and 2,8, resf^ctlvely. 
. Data source for administrators' responses tf Itfems' 2b)lc, 3, 4, 5, and 
6 Is AppendtK H, Items 20, 21, 22, 23", and 24, respectively. 

*Denomlnator Is number o# respondents (teachers, N'"35i principals, ' 
N-'6; administrators, N-3). ' 
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system should be used In basic skills Inservice education. The majority of 
teachers and all the administrators believe that an Inservice program should 
start by addressing teachiirs' concerns. Their opinion Is consistent with 
recommendations that have emerged from curriculum Implementation research 
(see Item 7 In Table 3). The teachers and administrators feel positively 
about the use of classroom observation and feedback In inservice education. 
This vi«w is consistent with another set of, research findings (item 8 in 
Table 3). Again, ""consistent with research findings (item 9 in Table 3), 
almost the entire sample believes than an inservice program should begin with 
initial training and should be followed at intervals wl,th further training 
and refresher experiences. 

Table 43 also presents the sample's preferences concei^nlng inservice 
training sites. A variety of sites are acceptable, with the most desirable 
site being the teachef^s school. Consistent with this preference, , some or 
all of the training In the basic skills experiments descTl^ed in Chapter 2 
occurred in the teacher's owh school. The educators have no clear preference 
about who the trainer should be, rior does any clear recommendation emerge 
from the research literature. Finally, several times for scheduling 
inservi^ie sessions are acceptable to teachers: inservice .days , regular- 
school hours (assuming a satisfactory substitute teacher), and just before 
the start of the school year. Weekends and early in the morning are 
unaccet)table to most educators as times for inservice sessions. 

Teachers and administrators were asked for th^ir preferences 
concerning the composition of participants in inservice programs, .the , 
results of data analyses are shown in Table 44. The majority of both groups 
prefer that the inservice program Include teachers across different schools. 
Almost without exception., teachers and principals feel positively about 
having the principal participate in inservice programs for teachers. 
Assistant superintendents also^feei positively about participating in these 
programs. N The views of these grouos are consistent with research findingb 
concernihg the role of the principal in teacher inservice education (item 15 
in Table 3). " . 

Table 45 presents educators' views about mandatory part;icipation in 
inservice education under the condition that the school district's^ goal is to 
improve students' learning of the basic skills. Most of the teachers arfd 
principals, and all of the assistant superintendents, believe that 
participation should be mandatory under this condition. 

The <\ata analyses presented in Table 41 indicate that most educators 
in the sample? believe that direct instruction techniques are effective in 
improving student achievement. This belief does not mean, however, that 
educators will feel that they nete'd or want inservice education to improve 
their use of s^ch techniques. Table 46 shows that the percentage of teachers 
expressing interest in inservice programs varies according to the direct 
instruction techniques that would be coVered. For example', 83 percent of the 
teachers expressed interest in learning more about how to keep students on . 
task during basic skills instruction. Only 29 percent of them, however, feel 
positive about participating in any inservice program that would help them 
bring their instruction in line with the content of Standardized or 



•curriculum-referenced achievement tests 
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As shown in Table 47, all administrators ifi the sample advocate the 
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TABLE 44 / ^ 

Educator Preferences Concelrnlng Organizational Context for* 
Xnservlce Education In Basic/Skills Instruction - 
(N « Number of educators) 



Feature of Organizational Context 



Assistant 

Teachers Principals Superlntendehts 
N % N Z N Z 



la. 



(Teachets) What Is your first 
preference concerning who your 
fallow participants will be In 
an Inservlce on basic skills 
Instruction? 

1« Just teachers from my own 
school 

11. Just teachers from other 
schools 
111. A mix of 1 an(]i 11 



8 
2 



25% 
6% 



22 69% 



lb. (Administrators) What Is your first 
] preference concerning the grouping 
of teachers for Inservlce on basic 
skills Instruction? 

Just teachers from same school 
Teachers from different schools 



0 
5 



OX 
100% 



1 
2 



33% 
67% 



2a. (Teachers) How would you feel If your 
principal participated In a basic 
skills Inservlce program with you? 
Positive ^ 34 

Negative I 

2b • (Administrators) How would you 
feel about participating in a 
* basic skills inservlce program 
with your teachers? 
Positive , 
Negative 



97% 

3t 



6 100% 
0 0% 



3 100% 
b OX 



Note: Data source for teachers' responses to ^Itemis la and 2a is Appendix 
items 29 and 30, respectively. Data source for ^admlnistra tors' 
responses to items lb and 2b is' Appendix H, items 25 and 26» ^ 
respectively • ^ "V 
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TABLE 45 

Educator Preferences Concerning Required Participation 
In Inservlce on Basic Skills Instruction 
(N » Number of educators) 



« • ^ » ' * , . Assistant 

^Participation ^ Teacheris Principals Superintendents 

. n' Z N Z N Z 



Suppose that, a school district had 

the goa'l of Improving students' t 
learning of the basic skills. 
Should teacher participation 

be mandatory under such . 

circumstances? , ' *. . 

Yes * 27 82Z 5 83Z 3 lOOZ 

No , 6 18Z 1 17Z 0 OZ 



Q 

Note: Data source for teachers' responses to the ixsm^s Appendix 

* E/ltem 31. Data source for administrators' responses Is / 
Appendix H» Item 27. 



TABLE 46 

Teacher Attitudes Toward Participating in Inservice Education 
on Direct Instruction Strategies' 
(II » Number of teachers) 



I 

Would you want to participate in inservice | Total Sample 

education that helped you««« j N % ^ 



1. Find ways of allo^cating more time for * 
basic skills instruction? . , 

Yes 18 51Z 

No . . 17 49% 

2« Learn teaching techniques to keep 
' ^tudents on task during basic skills ^ ^ 

instruction? 

Yes . 29 83% 

, . No - 6 17%' 

3« Bring your basic skills Instruction 
more in line with content of 
standardized* or curriculum-referenced 
achievement tests? 

Yes , 10 29% 

No ^ 24 71% . 

4. Learn'how to use Gpdd and Grouws' 
approfieh to teaching, math? 

Yes • . 22 63% . ^ 

'' No 13 in 



Note: Data source for items 1, 2, 3, and 4 is Appendix E, ^it ems 
10,^ 16, and 20, respectively/ 
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Or TABLE 47 

Administrator Attitudes Tbward Advocating Inservice Education 
, on direct Instruction Strategies 
(N « Number of administrators) , 



Attitude 



Assistant 
Principals Superintendents 
N Z N Z 



1. Would' you advocate use of inservice 
education to help teachers increase 
their use of direct instruction 
■ strategies? * 

. . Yes 
No 



6 lOOZ 
0 OX 



3 lOOZ 
0 01 ^ 



2. Would you advocate the use of inservice 
educatibn to help- teachers learn how to 
use the Good and Grouws' approach? 



Yes 
No 



5 
1 



83Z 

.17Z 



2 
1 



67Z 
33Z , 



Note: Data source for items 1 and' 2 Is Appendix H, items 15 and 18, 
respectively. 
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TABLE .48 

Teacher and Admlnlatratdr Attitudes Toward Measurement 
% of Basic- Skills Achievement. 

(N - Number of educators) 



Attitude 



Assistant 

Teachers Principals Superintendents 
N Z N Z N Z 



1. How do you feel about use of * 
standardized tests to measure 
'basic skills achievement? 

Positively 12 44Z 4 80Z 

Negatively 15 56Z 1 20Z 

2m How do ypu feel about use of 
curriculum-specific tests to 

measure basic skills achievement? . ' ' 

Positively 11 44Z 5 lOOZ 

Negatively 14 56Z 0 OZ 

» 

3. Are -you negative towarid achieve- 
ment tests because you feel they 
will be used to evaluate teachers 
or hold them accountable? 

Yes, very much so 1 3Z 1 17Z 

Yes, somewhat ' 9 2655 1 ' 17Z 

No 25 71Z 4 661 



3 lOOZ 
0 OZ 



3 lOOZ 
0 OZ 



0 OZ 
0-- OZ 
3 lOOZ 



Note; Data source for Items 1, 2, and 3 Is Appendix E and Appendix H,- 
Items 5, 7, and 8, respectively. Low response for tocher 
sample to Items Land 2, Is due. In part, to lack of 
familiarity with standardized and cujrlculuii-referenced te.sts 
(see ^pendix E, Items 4 and 6). ' 
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use of Inservlce education to help teachers increase their use of direct 
instruction techniques. The majority of them are also favorable toward Good 
and Grouws' inservice program on direct instruction for elementary' 
■athematics. A few administrators and a minority of teachers (see Table 46, 
itfem 4), are not positive about an inservice program built around this 
particular model of direct instruction. 

The criterion of effectiveness in recent research on badic skills 
inservice education has been student gain on achievement tests measuring 
basic skills (see item 27 in Table 3). The sample' of educatorsjea* asked how 
they felt about the use of such tests to measure studentr'^'achievement of 
basic skills. As shown in- Table 48, all of , the assistant superintendents and 
most of the principals are positive About the use pf t;nese tests. Almost 
half of \he teachers, however r:1iave negative feelings about these tests 
irrespective of whether they are standardized or curriculum-specific. At 
least part of their negative attitude can be tracefl to the fact they feel 
these tests will be used to evaluate their performance. 

Summary. The results presented above indicate that teachers and 
administrators generally agree with the recommendations that have emerged 
from research concerning the elements of effective Inservice programs for 
improving basic skills instructioli. Agreement with the recommendations, 
however, does not mean that they desire Inservice programs bas^d on the 
recommendations. Their, endorsement of such programs varies depending upon 
the particular teacher competencies that are the object of training. Also, 
the results presented in Table 48 suggest that many teachers and some 
principals would not advocate these inservice programs if they are connected 
conceptually or in practice with student performance on achievement tests. 
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CHAPTER 5 
Discussion 



Four objectives for this research prpject were stated In the first 
chapter: * " . u 

^ 1. To develop d set of dimensions for characterl^slng / 
Inservlce programs. 

1. To Identify dimension-related, practice^ whps^ 
effectiveness has been demonstrated through 
research. 

3. To determine the e:ttent to which research-yalldate^ 
Inservlce practices are present In current Inservlce 
activities. 

7" ■ ■ • 

4. To determine the/extent to which teachers and admlnl- ^ 
strators have^ j^posltlve attitude toward r^earch- 

^validated InserVlTce^ pl^ctlces and toward current 
inservlce practices. ^ ^ 

The following discussion is organized around these objectives. 

Research Objective 1 • 
The Dimensional Stlructure of Inservlce Education Program s r 

? \ ^ ? 

The, conceptual frameworka <fbveloped by the ISTE Concepts Project 
staff (Joyce et al. 1976)^ by curriculum implementation researchers (Fullan 
and Pomf ret 1977) , and by olhers proved useful in thinking about how to 
characterize the structure of inservlce education programs. A total of 27 
dimensions organized under 6 major headings were identified as Involved in 
the design of an inservlce program, however brief or' long, however limited or 
Extensive iij scope. 

/' / 

This analysis of the multi-dimensional character of* Inservlce 
education suggests the following three generalizations.*^ First, inservlce • 
education forms a complex subsystem within tKe complex System of schooling. . ^ ' 
Even A simple Inservlce activity can Involve students, teachers, principals, • 
centra^ office administrators, external ^ralners, i^ml persons representing' 
various constituencies. A temporal sequence of ti^acher effects leading' to 
student effects needs to be conceptualized. Organizational content, and^ 
governance structure must be taken into account. The second' gi^nerallzatlon 
is that inservlce education is linked in complex ways to the work of schobls. 
It is linked to school goals ^ to school curriculum, and to school assessment. 
The third generalization Is that Inservlce programs extend over^ time and are 
linked to other systems pf schooling that extend. over time. , • ' ? 

These observations about characteristics of Inservlee programs seem^ 
obvious once stated. We believe, homver, that the conci^pts of systea. 
cdmpleaclty. and teaporallty are fyndaa^tal to undeostandlng Inservlce 
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educatlpn. Without thes^ concepts. It is not possible to «nje""«d "search 
findings on inservice effectiveness -^or is it possible to J' 
patterns of inservice practice. Many inservice activities «PP«".f "P^J^^.^' 
^•example, an afternoon workshop for distrfet teachers on how «=V^«lP ""^^J" 
take standardized achievement .tests. AUhough simple on the ^ 
activities represent a complex convergence of elements from several ^operating 
systems, within the district and beyond. Also, the compression of the 
' activity. toVa single afternoon reflects the particular way in which 

stakeholders in the activity have decided to manage the temporal nature of 
change procdl^ses. " ' 

' <% ■ 

Research Objective 2 * 
C haracteristics of Effective Inservice Programs 

It should be understood that the effgctive inservice practices listed 
in Table 3 are a construction. The list is a synthesis of findings from 
, several lines of research^^ inquiry. Few. if any. current P'^f^JJ^^ 
^ incorporate all of these practices in a systematic manner. The major studies 
InS^ in the revi^ (i^derson. Ever^on. and Brophy.1979; Crawford et al. 
1978; lod and Grouws 1979'; Stal lings .1980) are evaluations of experimental 
inservice programs of brief duration. None" of the studies Investigated 
lUservice programs within the context of systematic school improvement. 

Despite t^se limitations, the outlines of a model of an effective 
inservice program for improving basic first 
The model assumes a temporal sequence of d«<=i«i<'"-^'^J^*^^^f J'^*'^^ "r*' 
step is to decide on basia skills achievement as a priorTty goal for school 
iipJovement (dimension 5 In Table l).' This decision^may result from a needs 
assessment *of significant stakeholders (dimension 24), from students 
acStev^eit beJnl below an expected level (<fimension 6) , from expectations 
Sased Tstudent^chievemenX data (dimension- 27) . olr perhaps from sqme other 
set of considerations. In fact. Uttle is known about how i"'P"^«»«"^ 
basic skill* achievement becomes cjrystallized as a priority goal by schools. 

, ^ . One of the next steps; if n6t done prevl<^ly. mu«t be to select or 

^develop achievement tests to monitor student l^ar^ilng (dimension 27). 

Without assessment data, administrators have no way of knowing whether their 
interventions are having an effect. Assessment data on f -^JJ^^^"^"^ 

in this context function much like school budget data. Administrative 
aSjist^ents need to b^ made «n a continuing basis until bc^'ooI ^J^^'J^^^ 
Income and expenses aire balanced. Similarly.., curriculum. and Instruction need 
- to be adjusted until student achlev«5f0ent has^ improved to expected levels . 
(dimension 6). - , ' , - 

' The logical next 8te> is ^o examine curriculum and Instruction to 
detemlne whether they can b« improved, 'For example, f .'t!!?^*'iviil« 
s^gests that such pra<rtlces as inqfeaslng allocated time fpr b-sic^skllls 
inifructlon. keeping students on task more of t^^/^»«' J^^^ 
stiGdent performance in the classroom (^dimension 1) are ^ .^^ 

instructional techniques for Increasing studfent achievement dimension 5). 
•Curriculum changes, such as b«4ngin& curriculum content in line with* 
achievemerit test coifcent, are also effective. 

' • ^ • 116 ^ 
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Once these elements of school Improvement have be^n Identified, 
Inservlce education becomes critical. Inservlce programs are necessary to 
help teachers implement the liiiprovement procei|s« These programs need to be 
designed so rh&t the* Improvement process becomes Implemented In th^ Intended 
fashion. Instryctlonal ccApetentles need to be operatlonallsed clearly • 
(dimension 2) and lii^ such a way that teachers understan^^ the performance 
level expectedtof them (dlmehalon They arlso need to understand clearly 

the expected level o| student basic skills achievement (dlmeniilon 4) that Is 
the goal of tde school improvement p^oce&s* .. 

, The ^Instructional competencies and expectations nelid to be taught 
using an effective Inservlce delivery system (dimensions 7-12) • ' The 
organizational context must also suppTort the Inservlce program. Teachers ^ 
must se^ each -others' as allies (dimension 14) working toward the^|i^mnon goal 
of school Improvement through the Inservlce process (dimension l^JT 
Administrators should also be Involved (dimension 15) so that they can 
provide supp9rt for the Inservlce objectives, that teachers are attempting to 
achieve. It Is Important, too, for administrators to screen, CQit dlstractoc^, 
Including other Inservlce opportunltle^ (dimension 16), that ml^ht deter ' 
teachers frdm workl/ig^toward the priority goals for school Improvement. 

A meaningful governan^ce structure for the Inservlce progt;^m Is 
needed. Participation needs to be mandatory (dimension 19) so that all 
educators who affect student basic skills" achievement are Involved. If 
participation is mandatory, how^ever, teachers need to be Involved in 
governance (dimension 18) and must be given incentives (dimension Zfe) so that 
they dp not reject the inservlce programs. Finally, teachers and other 
stakeholders n^ed to understand the policy underlying the Inservlce program 
(dimejision 23) and the relevance of the inservlce content to their own 
situation (dimensdon 25). Also, they nteed to have access to assessment data 
on their teaching performance aiu) student achievement (dimensions 26 and 27) 
so that they can see for themselves' whether'.the improvement process' is 
working. ' • . 

* This description of an ef^iigptive inservlce program for improving 

basic skills instruction is a highly ratldhal model. It clo0€ly parallels 
the objectives-'based model of curriculum development proposed by Ralph Tyler 
(1950). It Is doubtful, wlvether a school system would follow the exact order 
of step^^descrlbed above. Indeed, :^t is probably much more important that 
certain elements of the model occur than that they occur in a prescribed, 
sequence. ^ For example, the availability of an effective inservlce program 
for basic skills instruction might trigger the decision to make basic skills 
improvement a priority^ goal. 

*^ The essence of tl^ model that we see emerging from the research 
literatures that' the three subsystems of (1) curriculum mid instruction, 
(2) asseiisment, and (3) inservlce education must bf uaed in a coordinated 
fashion to achieve school Improvement goal?. This point is Illustrated by 
the following figure: ^ 



Figure 1 ' , 
Alterable Subsystems 



Assessment 



CurrlcUlixm , 

.ancl 
Instruction 



-8: 



i 



Inservlce 
Prograas 



Schoor Improvement 



Priority 
Goals 



All parts <^f the system are related t<J each other. Any one of the 
three functional subsystems is probably insuffidlent to produce significant 
progress toward priority goals. 

This description of effective inservice education is admittedly 
sketchy. Most of the research on which it is based consists of descriptive 
research, correlational research, or laboratory- like experiments. In its 
favor, the description is consistent wfth practices ^t are necessary and 
effective in other goal-based enterprises (Drucker ,1974) . 



Research Objective 3 
Characteristics of Current Inservice Programs 

*The figure at the end of the preceding section' provfdes a frnjnework 
for describing the current status of insefvice education as i^ is experienced 
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by elementary teachers. In this section we will exumlne our survey results 
to determine whether Imervlce actlvjLtles are part of a school improvement 
process. We will also examine how the^e activities are articulated with 
district! priority goals, assessment, ^nd curriculum and Instruction. ' * 

Finally, we will examine the effectiveness of gurrent inservice education as 
a system for del^yeriixg instruction to teachers. 

Linkage of inservice activities to school improvement. A surprising 
finding is that only 18 percent of the inservice •activities were perceived as 
being for the, purpose of school or district improvement (Table 30, item 1). 
The majority of the activities (67 percent) were'^ perceived as being for the 
purpose of personal professional improvement or satisfying credent ialling 
requirements. 

' * . ■ > 

Other findings also suggest that iuMrvice activities are weakly 
linked to a school improvement process. A formal school Improvement program 
is usually justified by a public needs assessment, yet only 24 of' 197 of the 
inservice activities in the sampl^ (Table 32, item lb) were selected on the 
basis of a needs assessment. ^ . ^ • 

School improvement programs generally extend over^a period of years. 
If inservice activities were intended to support these improvement programs, 
we would expect the<|k to extend over substantial time periods, too. The data 
reveal, however, tliat almost three-'f ourths of the activities extend for just 
one session (Table 16). Ninety percent of' them are completed In a school 
term or less, and 90 percent are completed in four work day« (32 hours) or ^ 
V less <Table 15). 

Analysis of the inservice activities suggests that the great majority 
of them have a limited focus. They deal with small elements of curriculum 
and instruction, for example: 

^ learning how to prepare motivational materials 
in language arts ; 

— listening to a lecture on right brain/left ^bralrt 

— learning about the district's pupil discipline handbook 

— learning how to use artwork to stimulate writing 

. — learning how to. stimulate student verbalization 

These activit-ies and others are uninformed by a larger ''conception of 
curriculum and instruction that is articulated across grades within a school 
^nd across schools. There are exceptions t& this generalization In our 
sample, for example. Involvement of teachers i^ developing a districtwide 
^ language, arts curriculum; improving the district's reading program; or 

introducing Madeline Huhter's Instructional Theory Into Practice program 
districtwide.' The dominant focus of the inseVvlce activities, however, is on 
small parts of the teacher's work rather than dn improving a total system of 
curriculum and instruction across classrooms otsacross schools. ^ 



We did not de.l.dli^ctly in ihaiyses thus far cOBpletecl with district 
spoMojshlp of teachers; Inservice activities^ The analyses presented In 
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Table 30. however, provide indirect evidence that, the ^majority of Insetvice 
activities are district-sponsared Almost 80 percent of the activities^ . 
involved more than one teacher ^rom the same school (item 4) ; -65 i^rcent 
involved teachers from different soJiooIb in the ^dstrfct (item 5); 65 percent 
involved the'teacher's building principal (item 6); and more than half 
involved district administrators (item 7). It i* revealing that insetvice 
activities are predominantly district-based, yet they tend to focus^on the . 
\ 'teacher rather than on school -improvement . These result? suggest Chat 

districts view the teacher rather than the total system of «oals, curriculum, 
assessment, and inservice programs as the locus of change. 

' Linkage of inservice activities to priority goals. A clear finding 
of the s urvey is tha^ inservice activities are fractionated across many goals 
rather than being focused on a few priority goals. The results shown in < 
Table 20 indicate that. the inservice activities are distributed across the 
entire range of the teacher's work. None of the subjects of the elementary 
school curriculum are represented in more than 11 percent of the inservice . 
activities. Even the range of categories shown in Table 20 does "Jt 
reoresent the full diversity of goals covered by the inservice activities. 
For example, many different aspects of reading curriculum and instruction are 
covered by the inservice activities classified' as "Reading. 

The results displayed in Table 22 further illustrate the .lack of 
priority goals. Most teachers participate in a variety of types of inservice 
activity rather than concentrating on one type. There are a few priorities, 
however! All teachers in district I participated in at least one Inservice 
activity involving reading, and almost every teacher in district II 
participated in at least one inservice activity involving language arts. - 

The analysis of inservice topics shown in Tables 20-22 does not ^ 
indicate whether the activitiSs were goal-directed. For example, an , 
inservice activity on reading instruction might focus on improving reading 
instructional processes, but make no reference to the goal of i'"P'^°;ed 
reading. achievement. The prevalence of goal-directed inservice activities 
was reported in-Table 21. Only 20 of the 27$ inservic^ activities (7 percent 
of the total) made any reference to 'student achievement outcomes, such as 
iq^roved school grades or. test scores. 

It appears then that curtent inservice activities are weakly linked 
to priority district goals or even to priority district /?!,rio*'?he 
apparently is to cover th-e entire range of teachers' work. It is left to the 
teacher to establish personal priorities. .The data shown in Table 22 
indicate though, that teachers tend not to select activities on the basis of 
fferSrioJmS;- rather, they sample a range of professional and curriculum 
* topics over the course of a school year. » 

Linkage of- inservice activities to assessment of s_tudent outcomes. 
Table 32 shows th"5t only 13 of the 213 in8,ervice activities (6 percent) 
included any assessment of student improvement or change connected with the 
teacHer's participatio^n in an inservice aptivity. Because the interview item 
was broadly worded, student improvement or changft does not necessarily refer 
to assessment of student achievement outcomes. The Actual incidence of 
student outcome assessment, then, may be even lower than that reported in 
Table 32. 

ERIC . ° ^ ^ " 



One reason for the low incidence of inservice^-related assessment is 
that so many of the inservice activities are of very brief duration. «The 
median duration is 4 hours (see Table 15). It Is unlikely that 
self-contained activities of such brief duration would. have a detectable 
impact on measures of student achievement. 

.Another indication of weak linkage between Inservfce activities and 
assessment is teachers' attitudes toward achievement testing. More than half 
of the teachers in t^e sampJLe feel negatively abo(0 the use of 
nationaIly-sj:andardized tests or curriculum-specific tests t a measure basic 
skills aclitevement (Table 4&). Almost a third of the teachers are negative 
toward' these tests^ because of concern that the tests would be used to 
evaluate tfheir performance or to hold them accountable. Teachers holding 
these attitudes would be unlikely to advocate a tight linkage between 
inservice education and 'assessment of student achievement. 

' • ^ / ^ ; • . .. 

Although the majority of teachers have reservations about formal 

Assessment procedures, they do make their own personal judgements about the 

effects of inservice activities on students. As shown in Table 35 (items 4 

and 5), they discriminate between those inservice activities that have 

cognitive or' affective' Impact on students and those activities that do not 

have such Impa^c^ 

TheB^ various lines of evidence suggest that current inseryice 
education is wealdy linked to assessment of student learning outcomes. 

Linkage of inservice activities to school curriculum and 
instruction. A. variety of data analyses suggest that inservice activities 
are closely li^ed to existing patterns of curriculum and instruction in 
, elementary schools. Almost 90 percent of the inservice activities are^ 
perceived as relevant to teachers' work. (Table 32 » item 2). Almost 85 
percent of the activities concern topics directly relevant 't;o curriculum and 
instruction in elementary schools (Table 20). More than a third of thern^ 
focus on the basic curriculum areas of reading, math, and language arts 
(Table 20). Also, a third of the activities were directly tied to a 
curriculupi adoption occurring in the district (Table 30, item 4). 

these findings demonstrate that current inservice educration is 
designed around the work of teachers, which involves using various 
instructional strategies to teach a curriculum to students. The loose 
linkage of inservice activities to assessment and ptlor^y goals ^ discussed 
above, suggests that the emphasis is on the process rathn than the outcomes 
of curriculum implementation and instruction. Analysis of teachers' J 
descriptions of the inservice activities reinforces this impresdion of the 
relationship between the activities and elen«titary school curriculum and 
instruction. * ^ 

. .With respect to process, most of the inservice activities appe^4so 
emphas^te the motivational aspects of curriculum and instruction.^ Relatively 
few inservice activities appear to manifest a task orientation to curriculum 
and instruction. This impression is confirmed by the analysis of training in 
direct instruction strategies as an objective of inservice activities. Just 
8 of the 279 activities made any reference to direct instructlpn strategies 
(Table 25, item 1). Also, only one-fourth or so of the teachers reported 
that they had ever received training in two of the direct instruction 



strategies: increasing time allocation for basic skills instruction and 
JncreSing tht overlap^etween ^ content, of basic skills inBtruction and of 
tests (Table 25. items 2 and 40. T^e maj^^ity of teachers did 
they had received training in keeping students en task at some point in their 



careers . 



Format of currefat Inseinrlce-^^ The\ following is a summary 

of the f o'^Si^hwa'^tin^icS that m<»t. commonly occur in current Inservlce 
activities : 

1. No readiness activity prior to the inservice 
(68 percent of the" activities; Table 28). 

2. No followup activities after the inservice 
(63 percent of th^activities'^" Table 28). 

* 

3. No checking for application .(76 percent of 
the activities; Table 28), 

4. ' Iq,?ervlce scheduled entirely during working hours 

(65 percent of the activities^ Table 29). . 

The prevalent format for 'iiisexvice activities is a single session scheduled 
during regular working hours, with no prior ^preparation and no followup. 
This Inservice format is inconsistent with the conditions required for 
teachers to learn new skills or to implement new curriculum. ^ 

Conclusion; In the preceding section, we concluded that effective 
inservic e prpgrams fo r improving basic skills instruction are embedded in a 
school improvement process in which the inservice program . 
procedures, and curriculum and instrvction work together in a tightly linked 
fashion to achieve priority goals. Inservice programs J" "J^/?^* 

quite different from this model. They consist predominantly of isoUted 
Inservice activities focusing on teacher development rdther than school 
improvement. The activities are loosely connected to priority goals and to 
assessment of. student outcomes. They are closely linked to school, curriculum 
and instruction; the emphasis, however, is on the Rrocess aspects of 
curriculum and instruction rather than on student achievement. 



Research Objective 4 
Teacher and Administrator Satisfaction with and Preferences 
Concerning I nservice Education 

One set of data analyses in the preceding chapter concerned the 
questiWJ!How-^f«€tive-and^^*tisfying is current inservice educati<>n as 
Deceived by teachers?" The results of the analyses indicate that teachers 
are satisfied with most of fheir inpervlce actlvitiea^over the coUrse^pf a 
year and they find them effectives Depending upon the dimension, being 
judged, they express satisfaction with 80 to 90 percent of the activities. 

It is not difficult to find reasons for teachers' high 'level of 
satisfaction with inservice education. The inservice sessions are usually 



s^cheduled during regular. work hours* As shown In Table 3 i, participation Is 
often voluntary (49 percent 'of the activities); Incentives for participation 
are provided (55 percent of the-actlvltles); sanctions for non-partlclifatlon 
are Infrequent' (25 percent of the activities^; and most of the activities 
Involve no or minimal out-of-pocket expenses. Most of the activities (88 
percent) are perceived by teachers as relevant to their work* Furthermore, 
very few of the activities have an evaluation component attached to them* 
Neither the teacl^pr nor hei: students are held accountable for results* 

An Intriguing finding Is that teachers felt adequately prepared or 
more than adequately prepared In the content of many of , their Inservlce 
activities before the activity began* This generalization applies to 
two-thirds 'Of their Inservlce activities (Table. 34, Item 3)* Xf teacher^ 
know the content beforehand, It Is unlikely that they will find the 
activities demanding or challenging* This finding "concerning prior 
preparation, and the other findings mentioned above. Indicate t^t Inservlce 
activities are generally designed to be comfortable^ undemanding experiences 
for teachers* Stated another way^ they are unlntruslve events; that do not 
require teachers to make major changes In their work patterns* This Is 
admittedly an Interpretation of the research findings, but It Is consistent 
with our understanding from other sources of how Inservlce activities 

generally are designed for teachers* • ' ^ 

• ■ ' ■ ,t ' 

Earlier In the dlscusslonN^e concluded that current Inservlce 
.education for 'elementary teachers Is loosely connected to priority goal/s, 
assessment procedures, add student .achievement, but It Is c^sely linked to 
the process aspects of curriculum and Instruction* Teachers apparently "are 
satisfied with this arrangement, given the fact that they express 
satflsfactlon with 80 to 90 percent of the activities In which they engage 
over a year's period of time* 

The findings of research question 5 In the preceding chapter suggest 
that teachers are willing ^to make some changes in this arrang^ement of 
linkages, but not others* Most teachers endorse the Importance of basic 
skills Instruction (Table 42) and agree that direct Instruction strategies 
%iould be effective In Improving the teaching of basic skills (Table 41)* At 
the "i^ame time, a significant proportion of the teachers would not want to 
participate In Inservlce activities whose content was linked to particular 
aspects of this Instructional approach (Table^46)* . They are especially 
resistant to the notloi* pf Inservlce activities des,lgned to help them bring 
their basic skills Instruction In line with the content of standardized or 
•A cuTrlculum-reference^ achievement tests* Seventy-one of the teachers In the 
sample would not want to participate In Inservlce education of this type ' ^ 
(Table 46X* » . ^ , 

The teachers are generally favorable to an Inservlce delivery system 
that! Incorporates research-validated training procedures * Th*e majority of 
teachers favor starting with sessions to addreiis personal concerns (Table 
43); having the traii^lng; extend over time rather than all at once (Table '43); 
: b^lng observed and receiving feedback (Table 43); Including the school 
principal In the ' Inservlce program (Table 44^); and imposing mandatory 
participation (Table 45)* \ ^ 

The teachers were not asked their opinion about linking Inservlce 
education ^to assei^smitnt procedures* It was determined, however, that the 

ERIC . . I2b , . 



majority of the teachers (56 percent) feel negatively about the use of 
standardized or curriculum-specific tests to measure basic skills achievement 
■(Table 48). Based nn this findlrig.lt seems unlikely that the majority ot 
the teachers, would favor a cldse linkage between Inservlce education and 
assessment o^ student achlevemeii^. ■ 

The teachers were not asked whether they would favor consolidating 
their inservlce efforts on a few priority goals , oriented to school 
improvement. Thus, at this point we do not know directly whether teachers 
would be willing to give up breadth of Inservlce content In order to gain 
depth of skill in a few areas of the curriculum. 

To summarize, tf^achers apparently approve of basic skills as a 
curriculum priority. 7hey aid© think that task-oriented, goal-directed ^ 
instruction, is effective, but man> of them hav^ reservations about . 
participating in' Inservlce education on this instructional approach. Many ot 
them would probably alsb resist close linkage bej:ween Inservlce education and 
assessment of student achievement. This set of conditions is represtented by 

the following figure: . ' 

Figure 2 
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The straight line In the figure Indlcate.s teachers' perception of a^ 
cause-and-effect relationship. Tfee broken lines indicates teachers 
perception that particular subsystems of schooling should not be closely 
Jinked to each other. The lin^s with question marks indicate unresearched 
•connections between subsyst^md. 



An Interesting finding from this set of data analyses Is that the 
administrators In the sample endorse more of the linlcages than do teachers* 
All of the principals and assistant su)>erlntendents advocate use of Inservlce 
education' to help teachers Increase their use of direct vlnstructlon 
strategies (table 47) • §lxty-three percent_ of the teachers (Table 46) but 83 
percent of the principals (Table 4t) are In favor of Inservlce education to 
help teachers leaili \im» to use Good and Grouws' direct Instruction approach 
to elementary -mathematics education* Forty percent of the teachers but 100 
percent of the administrators feel positively about the use of 
curriculum-specific tests to measure basic skills achlev^ent (Table 48) • 
Also, all but one of the administrators feel positively about the lise of • 
standardized tests for this purpose (Table 48) • Most of fhe admi^l8p::ators 
generally advocate the same type of inserylce delivery system as do teabhers. 

The set of conditions that we think exists for administrators can be 
diagrammed as follows: 

Figure 3 
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The figure illustrating administrator perceptions shows more close linkages 
between schooling subsystems than the preceding figure illustrating teacher 
perceptions* " ^ 
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■ - Limits to Validity and Generalizability 

The primary method of data collection was structured interviews. Our 
sense is that this method is much more >ef f ectiVe than use of questionnaires ^ 
in soliciting data aboMt teachers' inservice experiences. Use of this method 
may account for the much higher incixl4nce of reported inservice activities 
than was found in a previous questionnaire survey (Schalock 1977). At the 
same time the interview method may mi«8' Important Inservice phenomena that 
could be- detected using direct observation methodology, ^or example, the ^• 
objectives of the activities probably could be more accurately determined by 
observing the activity and materials Qncluding syllabus) associated with it. 

The distinction between intended and actual outcomes of Inservice 
activities was not sharply drawn in this study. Teachers were told: 

Think about the specific information, skills, * , 

or attitudes that you learned directly froit- . 

this activity. Keep in mli\d-, we don't 

want to know what was coyerfed in the activity; 

we just want to know what you think you 

learned, if anytl>ing. 

(Appendix C, p. 1) » » 

We- are not certain th^t teachers always kept Ws distinction in mind while 
responding* There may be valu^, in recording both types of information: what 
teachers believe they" learned; and what was actually covered in the activity. 

* * • 

The sample of districts, teachers, principals, and assistant 
superintendents was voluntary. The bias created by ^^^e voluntary^nature of 
ihe sample was probably in the direction of more favorable attitudes toward 
and greater participation in inservice^ education than would be 'the case in 
the population. The only'way to determine the parameters qf this bias, if 
any would be to replicate the study using randomly selected samples. The 
volunteer sample .is useful, though,, because it probably represents^hat 
happens under optimal conditions. If there are problems in InserVice 
education in this typ^ of sample, the problems will be probably be 
accentuated in more typical samples of teachers and schools. 

The study involved intensive analysis of a small sample of school 
districts in one region of the country". No large urban districts or very 
low-achieving schools were included in the sample. Again, replication is 
needed to determine the gkneralizibility of the patterns observed in this 
sample. • . ' -•■ , 

An important limitation of the study is that a one-year time- frame 
was chotfen fbr observation. There were indications that the patterns of 
inservice education in the sample districts change from year to year. 
Interest in inservice education appears to be growing yearly, ^so, the 
particular character of insetvice education in a district appears to depend, 
to some extent, on key personnel. As these individuals enter or leave the 
district, the patterns tff inservice education may change. The^time frame 
used in this study was' not long enough to determine the extent or pattern of. 
change in inservice e^jucation over time. . , 



ConclAlon . ^ 

% 

A descriptive survey of this type yields a large number of specific 
results. We think the results provide valuable » empirically-based ^ 
descriptions of the** surface phenomena of Inservlce education as ^It functions 
In school districts/ In schools, and In the lives of Individual teachers. 
The task before us Is to understand t;he^ underlying meaning of the observed 
events, especially the policy that drives lns€^rvlce education In Its current 
former. ^ ^ " 

■9 

The starting point of this stu^y was the set of four experiments on 
basic skills Inservlce education described In the first two chapters. We 
were Intrigued by the success of each of thescf experiments In demonstrating 
causal links beftwen (1) an inservlce interyentloti, (2) change in teacher 
performance; and (3) improvement in students' achievement of the basic 
skills. These demonstrations l^elate well to a production model of education 
and 'to the work of researchers attempting to understand administrative 
optil>ns for improving production functions in education (Duckworth 1981). 

,^ . ^ • % 

The findings of the present ^tudy provide strong evidence that 
current inservlce education is not based on a production 9odel of education. 
There^ is some evidence from the study, that administrators .favor such a mbdel, 
but teachers are generally negative to key elements of it, especially the use 
of public, standardized measures to assess student achievement. The current 
state of inservlce education appears to be based on an entirely different set 
of premises than those that guide a production model of education. 

] The figures and language that we used in the" preceding /section to 
describe the findings accord well, with a "loose cbupllng*A interpreta,tion of 
educational organizations (Weick 1976)# The practice of inseifvlce education 
seems tightly coupled topresent school curriculum and instruction, but 
loosely coupled to asseiMbht, priority goals, educational R&D, and 
Improvement of schools adHsystems. Weick has noted the advantages of loose 
coupling to maintenance -of school organisations, but* there are rlsl^ as well. 
The major risk of loosely coupled inservlce programs is that they can be 
easily ellminatjj|^ when school budgets must be trimmed. Another risk is that 
school improvement programs may be instituted, by mandate without linking them 
t'^o an inservlce education process. 

If this interpretation' is correct, it means that much or all of 
current inservlce education is not desigijed to Improve student achievement or 
to Improve the total school orgapisation. What then is the purpose of 
inservlce education? We can only speculate on . the answer to this question 
(here. Our hunch is that inservlce education, however it is originally 
/conceived, becomes «bent to the prevailing patterns of school system . 
functioning. Inservlce education appaars largely designed tobe unintrusive 
and undemanding of teachers. It reinforces prevUlllng curriculum and 
instruction, and is not Intended to alter them in a fundamental way. The 
focus of inservlce instruction on the instructional {Process rather than 
instructloiial outcomes is a major indicator that it is not intended to 
challenge the prevailing system. Another indicator of lack of challenge is 
the fact that teachers feel adequately prepared in the majority of inservlce 
activities even before, they begin participation. 

The fltidlngs of the study ralse^ intriguing questions about control of 



Inservlce education. There is a great rang4 of Inservice .topics across 
dJs'rIits and across teachers. This finding suggests a voluntary view of 
IhseivJce education based on individual choice both of participants and of 
sensors. Half of the inservice activities require mandatory P^^icipation, 
though, so there does appear to be some constraint on choice. We wonde-r 
about the utility of mandatory participation, however, because* there is 
Juae foUowup after t^e activities have ended and there is no mechanism for 
mandatory implementation of which we are aware. 

The issue of control /er curriculum also surfaces in our cursory 
analysis of inservice content^ Administrators appear to favor .use of 
-inservice education to encourage teachers to adoyt a centralized view of 
currJcuJL tLt is Uniform across tlve district and articulated across grades. 
In practice, the majority of inservice education topic. 

classroom-based aspects of curriculuii that do not require articulation with 
' Career units of school organization.. We have little idea at this point of 
i^^and Sy whom inservice%gend-s get set. Analysis of open-ended interview 
data from the study may yield some insight into this problem. 

Finally, we are puzzled about the individual differences observed in 
the study. The largest differences are at the teacher level. There is great 
variation in amount and type of inservice participation ^P^^J^^^fJ^"' 
Much less variation across school districts ,f 
dimensions (scheduling, 'Table 29; incentives. Table 3 ). ^^J^ " 
school-level analyses were done, but these also revealed ^^JXr 
of inservice activities. Table 13; hours of inservice participation. Table 
17) What consequences do t'heBe between-district , between-school, and 
blt;een!;teacher variations have for studeAts? We have no way of knowing at 
this time, but it does seem to be a question worth pursuing. 
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Appendix A • 

Table A-1 

Key Instructional Behaviot^ in Missouri 
Mathematics Effectiveness Project 



Daily Review (first 8 minutes except Mondays) 

(a) review the concepts and skills associated with the 
homework 

(b) collect and deal with homework assignments 

(c) ask several mental computation exercises 

Development (about 20 minutes) 

(a) briefly focus on prerequisite skills and concept^ 

(b) focus on meaning and promoting student understanding 
by using lively explanations, demonstrations, process 
explanations, illustrations, etc. 

(c) assess student comprehension 

(1) using process/product questions (active interaction) 

(2) using controlled practice 

(d) repeat and elaborate on the meaning portion as necessary. 

Seatwork (about 15 minutes) 

(a) provide uninterrupted successful practice 

(b) momentum— keep the ball rolling— get everyone involved, 
then sustain involvement 

(c) alerting— let students know their work will be checked 
at end of period 

, (d). accountability— check the students' work 

Homework Assignment 

(a) assign on a regular basis at the end of each math class 
except Fridays 

(b) should involve about 15 minutes of work to be done at 
home 

(c) shbuld include one or two review problems 
Special Reviews 

(a) we6kly review/maintenance 

(1) " conduct during the first 20 minutes each Monday 

(2) focus on skills and concepts covered during the 
previous week 

(b) monthly review/maintenance , 

(1) conduct every fourth Monday 

(2) focus on skills and concepts covered since the last 

monthly review 

■pp5ijf^ T. L. Good and D. A. (arouws. The Missouri Matnemat i c s 

*/ Effectiveness Project: An Experimental Study in fourth- 
grade classrooms. Jounial^^ 1979, 
71, 3S5-362, 

* 129 , . * 
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Table A-2 

» ...>•• 
' Instructional Behaviors Positively and Negatively Correlated 

with Achievement in Stall iftgs and Need&ls' Study 



Partiat Correlations' of Reading Activities and CTBS Scores 





Phaser 


. Phase II 




(N « 


16) 


(N 


-29) 


4 ^ 


r 


P 


r 


P 


Inltractive On-Task Instruction 










OiscussioaRevitw 


,40 


.001 


.63 


.001 


Rtadmg aloud 


.59 


.001 ^ 


. .28 


.05 


Drill and pvactict - 


.00 


N.S. / 


.38 


.01 


PralM ^ support. Tttding task ' 


.29 


.05 


.54 


.001^ 


Supportive corrtctivt teedback*' 


.50 


.001 


.28 


.05 


NcntnttractivtiDn-Task Instruction 










Classroom management 


-.24 


,05 . 


-.30 


.05 


Silehl reading 


-.23 


.05 


-.40 


.01 


Sustained silent reading 


-.20 


.10 


-.44 


.0Q1 


Written assignments 


.00 


N.S. 


-.41 


.001 


Off-Ta^k AcUytties 










Organizing 


-.34 


.05 


-.27 


.05 


Soaal iriteractkxis 


-.52 


.001 


-.30 


.05 


Negative interactions 


-.29 


.05 


.00 


N.S. 



'These variables are interaction variables. 



BEST COPY AVAILABLE 

» 



From: J. Stall ings. Allocated academic learning time revisited, 
or beyond tinle on task. Educational Researcher , 1980, 9, 
11-16. 
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TaBle A-3 

• •> 

Rosenshine's List of Elements' of Direct Instruction 



0 



ElemcnU ^ 


Poiitiv* Corr«l«tM 


Nsgfttiv* CorraUtM > 


Time and ' 
^ctivitiei 


Time »tructured by the teacher ^ 


Time spent on ^ 
arts, crafts, 
dramatic play, 
active play, 
ftories 




lime speni Om numuer unu ro»u . 
inc activitie* using textbooks and ^ 
academic workbooks, or in verbal 
interaction! on reading and math- 
ematics 


Gamelike 
activities 

^ Kumber of in- 
terest centers 

Larf^e number of 
different, con- 
current activities 
0 




Time spent in seatwork with^ 
acadewc workbooks througU 
which the pupils proceeded 
at theif own pace 


Hours of un- 
^ structured time 

Fre()uent sociali- 
zation 


Work Groupings 


. Students worked in groups 
ciifvkrvitiMl bv thfl teacher 


Free work groups 

Children working 
independently 
without super- - 
vision of teacher 


Teacher;Direc- 
tions and 
Questions 


Teacher directs activities 
without f^ving pupils choice 
^ of activities or reasons for 
the scleetion oi aciiviwca 


^ Teacher joins or 
participates in 
pupil's activities 

Teacher organues 
learning around 
pupiri own prob- 
km 








4<aruing is organised around 
questions posed by the teacher 


Teacher ap- 
proaches subject 
matter in an in- 
direct, informal 
way 




Teacher asks narrow question 


Teacher en- 
courages pupil to 
express himself 
- freely 


♦ 




4, 


Teacher asks direct questions 
that haviB only a single answer 


Teacher porniitj 
pupil td suggest 
additional or 
alternative an- 
swers 



BEST COPY A -MIABLE 

* ■ » *» 
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Table A-3 (Continued) 

■» f 


■ t 


- 

EtMMmU 


*- Bumtt«d 

Potitiv«Corr«Utis 


Negative ConrtUtM 




Adult commands, requests, or 
direct Questions, that hsd 
sa scsaemic focus 


Pupil initiates 
activities 

Pupil has freedom 
tO^lect 
activities 

Teacher commands 
and requests, 
nonacademie 

Teacher opeji* - 
ended que^ons» 
nonacademie 


Student Re- 
fponses 


Students sive s high percent- 
sfe of correct answers both 
in verbal interaction and in 
workbooks 


ClStld open-ended 
questions and 
nonacademie 
commands 


if 


Students are encouraged to 
attempt to answer questions 
(rather than saying ^'I don't 
know") 

J , ' ■■ 


Adult nona&- 
demic commands ^ . 
or r^uests, or 
open-ended 
questions 

Child nonaca- 
demic responses 

Child general 
comments to 
adults or among 

children 


Adult Feedback 

V 


Teacher irflmediately reinforoea 
pupil as to right or wrong 

A«4tilt. SMwIhArle ImH max Aiuidenuo 


Adult feedbadc 
on nonacademie 
activities (e^^ 
play, musie) 




Teacncr asks new question after . 
correct answer 






Teachck gires answer after in- 
correct answer 





Socaca*: Sullinc* aad Kuknwitt, FalUw Tkmfk TU-nm Otgrrfim XraliutMM; 



Soar. K-idKir n»ii«* CliiMrwn fnM*$4 MtnnirtmnU tnd Pupil J*n B. Brophy aad C. M. 

■tt»i,Proau-PrmlMt Cvrfd •<<»•* im llu Turn* T—ektr C/wIimiwu AM|r: f«Ml M*p»n' 
(AHMia, To 



£VMt« 



fronu-l'niluet Cvrfclt 

Tba UaivMkity of Taaa*. 1974). 



Fron: B. Rosenshine. Classroom 
The Psychology of Toachtn 



tnstructton. In N. L. Gage (Ed.) 
Methods. (75th Yearbook of the 



The Psychology of loacmng wetnoas . ^/atn Tearoqo^ or 
Watfonal Society for the Study of Education). Chicago: 
University of Chicago Press, 1976. 
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TEACHEL INTERVIEW SCHEDULE 

" ' irkJiOT A4IC 



PART ONE .. ; . j^^*^^^^ 



Teacher's Nanie 
School _ 
Date 



Give teacher a copy of this form. 



Inservlce 



AS you know, the purpose of t^ 
exoerTencesTTn Ws^Trl riHervTeWV warrg Jo l^^^^^^^^^l^ 
ex Kr eScel ov^ TRT gastyear. Be Torj ^[s^TlpugRTT^^ 

answer any of these questTonM y YO" so wlsh*^ 

■ T . /- . .. 

circle the appropriate answer. 

1. /sex. nrm 

2. Years of regular teaching experience 



ERIC 



3. Age (21-25) (26-30) (31-40) ^ (41-50) (SH) ' . 

4. GrJide level 1. 2. '3. 4,^: 5. 6. 

5. Abllltynevel of your students: 
Very low low medium ability high very high 

6. How difficult is this class to teach? 
Very difficult difficult medium easy . very easy 

7. Please describe your School as a climate for promoting your development 
as an educator. Are there opportunities for professional development? 
Ar6 your colleagues supportive of change and development? (Classify tne 
school climate based on the teacher's response.) 

Hiqhly Supportive Neutral Unsupportive Highly 

supportive ^ unsupportive 

8. Readjhis aloud to the teacher: \ 

Before we start our review, we will need a definition of Inservlce 
education . 

By 1 nservice education we mean any activity that is in tended^ to Improve 
- vour capacity as a professlona>"eaucator. tmb acITvlty can~be very brief, 
( l ike ' hea'rin" '^i^acI- cnoakor nr atteni^ina a school meeting) or extend 



I hearing a~gu'est speaker or ~attending a school meetTng) or extenc 
~a school yeaF^ longer (TTke atienoihg a series or woncshops to 



over a scnooi yegr ur iunae^ i » " ^ — ^. — - -r- — 

TieTp y ouTear nTiow To IwplemenT T^new curncuTum in your school >. For 
TTTo'Te afTTnservice activity you"tHbuld be in tTie roTe of a learner. 
- Yo^j"Tarn earFnevnniowTeage7 a s. Jwj!!^^r:m^not' 

T5veTearnea"aTTO1ng from thF TnservTce activity, ggjgthe actiTOy 
•tTFe' lncTu^eT TF Ws'lefim^ the presenters should nave intended 
Jearning'outcomes Tor~the parti cipaTrCs. r 

Probe (if required): provide some examples. - 
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One other point about our definition of Inservlce education. Inservlct 
acRyities can Invojve a variety of purposes;' ' y6ur perioiiaT professional 
qeveiopgent"TTor exawpie. learningl iow ^ iiianage lfress; preparing for a new 
educatorTglelT ^ Another purpose wigHf Be •tr TSprovT your^ea^ 
in tne ciassroow, sti fT anotner purpose nffgHT ftrto tg ^nvoTvir Tn"T^gRw 

or dTstr^TIiyrQywgnrpTO^ (for exSiipTenear^^ a " 

schoolwlde discipline project; learning about a dlstr1cFachleveiiient'"test1no 
* prograii)»~ ~ — — ' : ; — , — '• — -* 

Does this give you an idea about what we mean by. inservice educatio n? : 
Any questions7 ~~- 

To review, an inservlce activity can be short or long; it can be . 
intormatlonaT. attitudTnal. or skTn'-orierrteg;" Tnl^rtncan BTT^ 
variety of purposes* [ " — ~" 

9. Now let's do a month-by-month review beginning June 1981. Do you recall 
• anytT>Tn?l:lMrt"month? — — ^— ' — — 

Write responses on next page. Continue up to preseht month. It's not 
important that activities be recalled accurately in terms of the month or 
months they occurred. 

Why don't yotf Just thinfe a minute more? Can you think of any other activi- 
ties In whTcF you parfTcipa^ea? r*-^- 

10. I'd UJcfi^ to ask about your . attitude toward inservlce activities. Gener al ly, 
■ now do you feeTaBouf inservlce? to what ^)ttent do y ou~seeirtti5ii out? 

Ask follow-up questions, then make a Judgement about the teacher's 
attitude, and make a rating. . 

Very positive positive neutral negative very negative /f- ' 

ill lM,*o 5et some idea of other activities you've engaged iiy over this 
TOg perio? - acTOTtTes^Tiat are more informaT li rrrature: buT wRTcR" confri-. 

buted to your development as a" ^acRer. In otheFwords. Ingrieitr thaf " 

yoiThave Been apie to incorporate into yoW'^Tissro^r ^%W[m~or 

^ protessioni T nTTe7m»ese activities migRT'incTuag 'sucTRR^^ 

taiKs with otherteachers^ infoHMTH f^adTngT'or^r^?^ ~ 

reiateT lo your ywrlc7 " [ — ~ ■ 

Write responses on page 4. Ask the teacher to estimate how often each 
such activity occurred. 



♦Decide (with teacher if necessary) on a discrete inservlce activity and begin 
PART TWO. ■ • 
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PitfaTl : Watch time! Don't go into detail at this stage. Give same activity 
number to act1v1t1e;s grouped as a discrete Inservlce program. 



Activity # I Month 



FORMAL -INSERY ICE ACltVITY 



June '81 



July 



August 



September 



October 



November 



December 



January '82 



February 



March 



April 
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* * * ■ 

PROBES: Names of magazines. Joumtls* etc; travel; conMinlly Involvement; extra 
currlcular; entertainment; recreational; clubs and associations; 
summer break activities, etc. 





INFORMAL PROFESSIONAL ACTIVITIES 


f m Frequently 
0 - Occasionally 
• S ■ Seldom ' 


1. 




" ' F. 0. S 


2. 




F, 0, S 


3. 




F, 0, S 


4. 




F. 0, S , 


5. 


.V 

i ' 

' J 


F, 0, S 


6. 




f.. 0, S 


7. 


> 


F, 0, S 


8. 


1 3 


F, 0, S 

- • 


9. 


i 


F, 0. S 


id. 




F, 0, S 
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"APPENDIX C 

TEACHER INTERVIEW;SCHEDULE I 
PART TWO 



Teacher's Initials 
Date 



Remember: All ,the following questions in PART TWO and PART THREE re.late to the 
discrete activity identified on this page. 



Activity # Titled: 



A. TEACHER OBJECTIVES 



1. TARGET COMPETENCIES. We want the teacher to focus here on increases ii 
teacher competence (knowledge, attitudes, and skills). 

We want to find out what you learned froin this inservice activity* Ti^'nk 
iEourThF "spec7fT(Firvr^ skins, o r ~aH^ifuBis that you learnea" ^ 

di'rectTlTfrom this activity. Teep in mi^. we dorTT wanl^ To T(n.ow what 
was covereaT nnEFie activity; we jusfwant to" TnovrwFrat you"lhlnk you 
Teamed, if anything . 

Steer the teacher away from student objeftives or process activities. 

i . K A S ■ . 



-1 1 



ii. K AS 



iii. K A S 



iv. K A S 



V. K A S 



Before moving to next Interview item, be sure to ask: Any other information 
skills or new attitudes you acquired during this activity? 

ErJc ' 137 144 



SIpE« or LONG-TERM EFFECTS. Did the activity hav^any effects on m 
otner UTan thoseHntended tty tRe Trii'^eFF cir^Te: yes/no. 

If NO, probe: sometimes the effects way appear over a short or long 
period - the learning you engaged In may have Uad to new Insights, 
feellngs^or motivation to do something (differently* 

in YES, record effects using same procedures as In Item 1. 





K 


A 


S ♦ 




















• 




- 












ii. 


K 


A 


s 








4 




























ill. 


K 


A 


s 


V 




4 














> 


















K 


A 


s 




\ 
































V. 


K 


A 


s ■' ' ^ ■ 




























• 









O 4 f 

3. OPERATIONALIZATION. 1 want- to know now hgSi clearly the objectives of the 
Inservlce activity were conjnwnica|ed~^o you-. Wa$ it TTear what inf^iTiatTon, 
attitudes, or ski 11 £» you were supposeT"to learTfT" CTrcie Yes/No. 



If YES: How were these communicated to you? 



4. EXPECTED LEVEL OF COMPETENCE. Were you given criteria for knowing when 
you achieved an objective? For exampTe, were you told F ¥in1imnn score 
tFat your pupTTs~sBolnd get on a test; orliow wFlen yQu""should use a 
parTlcUTar sMl 1 ;" orliow nHiclFtTnie you sHouT? spen? Wng a pamcuTar - 
activity fn the cla^sroomT or TwHrnjcH" you should interact wrER 
. parti cu 1 aF'slEticrents? Ci rcl e^ yes7n9~respoffse. If yes, ask: can you 
explain your response? \ 




5. 



COMPLEXITY . New professional learning can be complex because of the - 
amount you're~expected to mister, or because it requires you to Hearn 
something entirely new, or Jbecause you have to adapt wnat you"Tearned 
to your particular class room"s|1 1 tu a tTon ?"lTo'w complex was your 1ns.ervice 
actTvTTy in these respects? 'A^feen answer, probe; w^yf* 



6. RATIONALE. You may have bedn given reasons why you should learn the 

particular InTormation, aHTTude, or skills Tor some reason. WFTaTTeasons 
were you given. If any ? 

Focus on what the trainer or sponsor gave as reasons, rather than on the 
tsacher's own reasons. 



♦Before proceeding the teacher should answer rating form A. TEACHER OBJECTIVES 
(see PART T+iREE). Pitfall: Preve;it completiprfi of any otTier rating forms. 
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B. STUDENT OBJECTIVES 

7 . MEEDS ASSESSMENT . Did aryone ask ^ ii^hether you needed the training pro» 
vided by this insietvTce actlvi"^ cTrcle; yes/no. 



Are ^ou aware of whether this^ in service acttyity was selected as £ result 
pTHa fomaTlieiitrs assessiHitir "of teache7s7 circle: yes/no. 

If yes, ask How was this conducted? 



8. TARGET OBJECTIVES. We want to find out what effect the inseryfte activity 
was supposed to havg on your stuclents. Hal^ inservice « ctivmes claim to 
TfeTp teacfiers'TeTprth^rrTfuden.ts lear'n tetter or learn'^certain currTculQiw 
content, or haveTetter attitudes, was tHTTTrue o^TTo'^r inservice activity? 
circle: yesTnoT What were tne s[>ec![¥Tcln^enSSS effects? 



1 . 



ii. 



iii. 



Probe: Anything else? Can ^;ou be wore specific? 



9. MEASUREMENT OF -STUDENT OBJECTIVES. Sbtnetimes an inservice trainer or^ 
sponsor will give a test or some other _asse&sment~aevice like a queiyton- 
naire to you r sWderifsT " Tlie purpose or tni s assessment IT To "aetermine 
whether tneTtu3ents change? Or improverf Tt T'soffle way as £ result of you par- 
ticipating jn the inservice ayEivity. DiT 'sucTTan assessment occur? 
Circje: yes/np. If yes, ask for an explanation. 
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10. EXPECTED LEVEL OF PROFICIENCY, ksk this question only if the-teacher 

answered "Yes" to question #9. Did the inservice trainer or sponsor 
convey any expectation to you ' " " ^ ~ 

this assessment measure would 
Ti rthinrnservlce~actlvlV^ 
TFe expectation? 




11. SIDE- OR LONG-TERM EFFECTS, The inservice activity JMy have had effects^ 
on your student other than those Intended. These effects mayHave 
occurred right away or over a longer pen od of tlni?T you notice 
any sticb ef fectsT^CTrcTeT" yes/no,. If yes, asfc; . WhaTwiere tReTTTects? 
TTIIirrask: Why? . " 



♦Have the teacher complete rating form B. STUDENT OBJECTIVES. 
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C. DELIVERY SYSTEM 



12^ READINESS ACTIVITIES. Readiness activities nw(y Include helping you become 
aware of the need for the inserv'ice activity; or securing your agreement 
anT Twnerslvrp'' TrrtT<r "inservi^e actTvity; or deTTinglTrghyour concerns about 
fFe ins ervlce actTvTty. Jlitl yoTTpartlclpate in any sach readiness 

- activities? Circl^:^-yef7?»or^ ^yes," a$K: " TlhTTwere. tne readiness 
activities? " : . 



13. (a) INSTRUCTIONAL PROCEDURE/MODE. Please describe briefly the instriictional 
format that was used to present the inservlce actlvi"^ 7" 



(b) LEARNING PROCESS. What learning process do you feel you were 
involved in^ during the inservlce activity? ^e.g. Tsmall group project. 
discussion, hands-on activities) . K 



.14. (a) MAItJTENANCE/MONITORING. Were there any follow-up activities to 
help you maintain or increase what you learned during the initfaT set 
oF TnservTce actlvTTies ? circTeT" yes/nol W yes, asTcT^ Please describe 
tHem. 



(b) Did anyone check after the initial set of inservlce activities to 
see wTiether you were apply inTwhat you learne?? circle": yes/no. lTyes» 
a^: Please'^scTTFe'liow this~cHecTn7rg process ' was garried out. 



15. TRAINING SITE. Where' did the inserviqe activity occur? Be sure to 
determine whether there was more than one training site. » 
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16 RELtVANCE. Please conment 00 how relevant W jn^^ 
Jour 5?^f^^ 

17. TRAINER. 0 i d the insemH ac^^ 

weaker- oFTtTver person or p ersons? Circle; yes/no. If yes, ask. h lease 
iflffejyi^^ Be sure to elicit the- perspnTsTT" 



affiliation. 



18. SCHEDULI)4Q. What time or times of day was the- inservice activitjr. 
scheduled? ^ 

(a) morning afternoon evening all day 

°(b) morning recess lunch break prep, time _ teaching period 

weekend summer break _ term break _ . other? 



(c) Did the inservice activity occur alj jt once, or oj^ 
T^q. week/s, term/s, yearTTf , • 

(d) <:tArijnfl and endino. date (approximately) of t he jctivi^? began 



ended . 



(e) Approximate*ly how much of your time was spent directly participating 
i.n. this inserv Tce acirvTTy7 



(f)* What percentage of tMi t1j!!i durin£ your regular working hours? _% 

19. COSTS, niri it cQgt vou anything out-of-pocket to pa^j ^^cipate in tjjjs 
activityT ^cTrcTeT yTs/noT^ ask; How much did n 

materials, tuition, special travel . and lodging? ^ 

If no. ask. Who paidT 



♦Have the te^fher complete rating form C. DELIVERY SYSTEfj . 
O 143 ^ 
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D. ORGANIZATIONAL CONTEXT 



20. PURPOSE FOR PARTICIPATION. We'd like to know the primdry reason why you 
' S2i ^"volved in. this in service acTTvTty. TTease explain WHY? 



\ Probe for an ©pen ended response then confirm according to: personal 
1 professional development/school improvement/credential ling/a chance for a 
' ' break from the classroom/others 

22< CONCURRENT ORGANIZATIONAL CHANGE, (a) Was your building principal 

Invoi'ved . in the in service activity ijl arr^ wayT " circle: yes/no. If yes, 
•a$k : How was he or she involved? 



Prbbe: Prior to the activity? During? Following? Informally? (through 
classroom visits, casual conversation, formal /informal reports) 

(b) Colleagues/others (e.g. parents, pupils, community personnel). 



(c) Were school district administrators involved in the . inservice 
activity in any way? CircTe: yes/no. If yes, aslcT ^o was involved? 
Then ask ,1Tow were they involved? *^ 



(d) Then ask: Were any curriculum or other changes being made in 
your school or schooT^JTstrict thai were re la ted to tne 1 n servTce^ 
.activity ? ^^1 rcTel yes /no . I r7e?,"Tsir: What - were^esTchanges? 



*Have the teachfer complete rating form D. ORGANIZATIONAL CONTEXT. 



E. GOVERNANCE 



23. GOVERNANCE STRUCTURE. There probably was an .Individual oc^qa[;oyp^ which 
was responsible for makTngTey decisions concerning your^nservi ce activi- 
TTesI — This i ndivT?uaT"or group was probably involved in selection of inser- 
' vTce ~objeHives, design~a ragflvTEtes, and anocatton of resources. Who was 
tRTs individual or groupT " 



24. TEACHER PARTICIPATION IN GOVERNANCE. To what extent did you participate in 
making decisions about what your -i nservTce activity wouTdcover, and how 
would be run? . ^ • 



If the teacher indicates some participation, ask: Can you give a few 
examples of your participation? i^v " 



25. INCENTIVES. We'd like to know whether you received any -incentives, compen* - 
sation, personaypay-ofTT or other rewargs for parti cTpating^ in this 
inservice activity. Did you recel ve"any7~ Ufrc Tei yes/no. TT yes , ask : 
Wha^t were they? 



26. SANCTIONS. Sometimes there are negative consequences, real or threatened, 
ass ociated with an inservice activity . These negative consequences may De 
associated wvEF refusing to participate in the" "acffyT^ ; for poor perTor- 
mance in thF Tctivit y , orTor not impiementTng the training. Were you 
given notice about these or~^iTyou experience such negative consequences? 
Circle: yes/no^ If yes, ask?~ VRat were the negative consequences? 



♦Have the teacher complete the "Governance" rating form. 

*Put the teacher's last name on all the rating farms. Stapl^e or 
paper-clip them to this interview schedule. 

♦Arrainge date for next interview (if required). 



^PBNDIX D 

.TEACHER INTERV*IEW SCHEDULE ! 
PART THREE 

^ ■ 

Rating Form A - 
TEACHER OBJECTIVES 



Initials: 

Date: ' 

Acti vity #1. 2, 3. 4. 5 



Please CIRCLE your choice: 

Very Satisfied 
1. I was' Satisfied 

Dissatisfied 
Very Dissatisfied 



with what I was supposed to learn from this activity. 



2. How negative or positive were the effects of this activity on you? 



(a) Side-effects 

Very negative 
Negative 
Positive 
Very positive 
None 



(b) Long-term effects 
Very negative 
Negative 
Positive 
Very positive 
None 



3. How clear were the objectives of the activity to you? 
Very unclear Unclear Clear Very clear 



4. How pertinent was this activity to help you instruct children in the basic 
skills of language, reading, and arithmetic? . 



Not pertinent 



Pertinent 



Very pertinent 



5. How complex was what you were expected to learn. from the activity? 
Very simple Simple Complex Very complex 
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Please CIRaE your choice: 

Very Satisfied 
8. I was Satisfied 

Dissatisfied 
Very dissatisfied 
Not applicable 



Rating Form B 
STUDENT OMECTIVES 



Initials: , . 

Date: ■ 

Ac ti Vi ty f ^, Z, 3, 4, 5 



with the intended effects of this inservice 
activity on stMdents. 



9. How positive or negative were the ^ffec'ts of this activity on your students? 

. (a) Side-effects (b) Long-term effects 

Very negative Very negative 

, Negative Negative 

/ Positive Positive 

Very positive Very positivie 

None None 



Very satisfied ^ 
10. I was Satisfied with the way thatthe student effects associated 

Dissatisfied with this inservice activity were measured. 

Very dissatisfied 

Not applicable » 



Initials: 
Date: 



Activity # i. J{. 3 A K 

Rating Form C 
DELIVERY SYSTEM 

Please CIRCLE your choice: 

12. Readiness Activities 

Not Very Very 

; Applicable Satisfied Satisfied Dissatisfied Dissatisfied 

13. Learning Process 

Not Very 

Applicable Satisfied Satisfied Dissatisfied Dissattsfied- 

14. Follow-up Activities 

Not Very . Ver^ 

vApi^licable Satisfied Satisfied Dissatisfied Dissatisfied 

15. Training Site ■ ' ' ■ 

,not Very Very 

Applicable Satisfied Satisfied Dissatisfied Dissatisfied 

16. Relevance of Content 

Not Very ' very 

Applicable Satisfied Satisfied Dissatisfied Dissatisfied 

17. Inservice Trainer(s) 

Not Very Very 

Applicable Satisfied Satisfied biss^tfsfied Dissatisfied. 

18. Scheduling " , 

Not Very Very 

Applicable Satisfied Satisfied Oissatisfied Dissitisfied 

19. Cost „ . 

' Not Very / Very 

Applicable Satisfied Satisfied Dissatisfied Oissatisfied 



Initials: . ■ 

Date: 

Activity # 1, 2, 3, 4, 5 

' Itatlng Form D , 

ORGANIZATIONAL CONTEXT 

Please CIRCLE your choice: h 

20. My primary Imnedlate purpose for participation: 

To Improve nyself professionally ' . 

To help Improvie my school . 
To help Improve rny school district 
• *To satisfy a credential ling requirement » 



' Please CHECK ALL that apply: 

21a. I did the Inservice activities 
. By nysel f 

With otheFTeachers from ny school 

With other teachers from dlfferenrichools in my district 
With other teachers at rny grade level ^. " 

With other teachers.it pther grade. leyeT?* 



Please CIRCLE yoq,r choice: 
Very satisfied 

21b. 1 was Satisfied /with the group of teachers who participated In 

Dissatisfied this fnservlce activity- with me. 

Very dissatisfied . • 

Not applicable ^ . * 

. . J? ' . ■ • • 



Very satisfied 
.22a. I was Satisfied 

• Dissatisfied 
Very dissatisfied 
Not applicable 



with my principal's Involvement In the Inservice 
activity. 
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Very satisfied 
22b. I was Satisfied 

Dissatisfied 
Very dissatisfied 
Not applicable 



with my school distrlct/qentral office 
administrator's involvement in the inservice 
activity. 
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Initials: 

•Oite: : — 

Activity # 1. 2, 3. 4 ' 



Rating Form € 
GOVERNANCE 



Please CIRCLE your choice: 

. ..: . ... .... . . J . , 

Very satisfied r- 

^ lull^lii^a with the pollcy-malctng that led up to this 

S:! !; ?? Inservlce: activity. 

Very dissatisfied 

Mo opinion 
Very satisfied 

^ Ve^ Slssn^^^^ design of this Inservlce activity. 

No opinion 

25. My Involvement In this Inservlce activity was- 
^ Voluntary . ^ ^ . 

Required , • - ■ ^ 

Not required, but felt pressure to participate 

. Very satisfied 

' 0?«a%"s?1ed . t'^uZ 
Very dissatisfied. 

No opinion ' . ^» _ 

nTlf^ectf'*"' »ery positive effects 

'''•I5u*rtir'" """^^ to pr»«te the cognitive growth of ^ 

^WeMlcf'"* positive effect . 

w'effelt very positive effects . 

""•ISiSert""'" the '"ectl've growth of v 

n«'Jti;i'eff«r*'" positive effect . 

'°"lJ«JuJ^ JS'thSIJs'lJSiJ."?"?!!"'."" — *'^« .""owledge/skins/ 
More then adequate Adequate Less than adequate 
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TEACHER INTERVIEW SCHEDULE II. 



Meredith D. Gall 
Fay Hal si ey * 
Rob Baker 



University of Oregon, College ,6f Education^ 
Center for Educational Policy and Manage«ent 
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Date 



Teacher Interview 

The purpose of this interview is to get your perceptions about teaching the 
basic skills to your students. We want to learn two things: how you feel about 
teaching the basic skiTIs; and how you feel about the possible use of inservice 
education to improve your teaching of the basic skills. 

When I say "basic skills," I an referring to basic skills in reading, math* 
and language arts. 

. U BASIC SKILLS AS A GOAL OF SCtiOOj-IHG 
1. How important do you think it is to teach the basic skills to your students?. 
Critical Important Slightly important Unnecessary 
Explain your response: 



2. How important do you think it is to teach Jhe basic skills relative to other 
goals of the curriculum? 

Much i - Much 

more More Equally \ Less less 

important important important important important 

.1S . * ■ 

Explain your response: 
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How satisfied are. you with ytiur students' progress In learning the basic 
skins? I . • 



Reading 

Very satisfied 
Satisfied 
Dissatisfied 
Very dissatisfied 



Math 

Very satisfied 
Satisfied 
Dissatisfied 
Very dissatisfied 



Language Arts 
Very satlsTTed 
Satisfied 
Dissatisfied 
Very dissatisfied 



Explain your response: 



If. MEASUREMENT OF BASIC SICILLS IN READING , MATH , LANGUAGE ARTS 

The basic skills are usually measured by the use of standardized 
achievement tests. Are you familiar with uuch standardized tests as the 
Stanford Achievement Test, the Comprehensive Test of Basic Skills (CTBS), 
or the Metropolitan Achievement Test? j. ' 

Circle: Yes No ^ 

(If yes. ask question 5, otherwise skip to question 6) 

If "yes" to Ai how do you feel about the use of such tests to measure^ 
your students'. acKlevement of the basic skills? 

Very positively/ Positively Negatively , Very negatively 
Explain your response: - ^ 
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6. The basic skills are sometliMS iiea'iured by the use of achievement, tests 
developed by school district staff. Th^se tests are developed to 
Measure the specific objectives of the district's cyrrlculun. Are you 
fanlTlar with the use of such locally-developed tests In your district or 
, In other districts? ' 

C) . ' ■ . ' 

/ . * 

circle: Yes No 

(If ye&, ask question 7; otherwise skip to qijestlon *8.) 



7* If "yes" to 6: tiow 'do you feel about the use of such tests to measure 
your students* achleveinent of basic skills? 

Very positively Positively Negatively Very negatively 

Explain your response:; 



8. Some teachers feel negatively about the use of standardized achievement 
tests or achievement tests developed by their df strict* They are 
negative because they .feel that the jichlevement scores will be used to 
evaluate their teaching performance and to hold them accountable for 
their students* ach1evment« Do yoti have such feelings? 

Yes, very iwich so Yes^ somewhat No 

.Explain your response: 



16. 
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The basic skills are sometifnes measured by the use whievement tests 

in other districts?^ 
Circle:. Yes No 

(If yes, ask question 7; otherwise skip to question 8.) , ' 

If "yes" to 6: how^do you feel about the uie of such tests to measure 
your students' achievement of basic skills? . 

Very positively Positively Negatively Very negatively ' 
Explain your response: 



Son« teachers feel negatively about the ^^.J^Sf^^i^J J^^JJj""^"* 

SrsftM rtMi 5S^^^^^ to. 
eTulll 'trerrleSnrperformice and t6 hold them accountable for 
their students' achievment. Do you have such feelings? 

Yes, very much so Yes, somewhat No 



Explain your response: 



IIK ^EACHIWG MODELS FOR BASIC SKItLS OF READING . MATH, UN6UAGE ARTS. ' 

Researchers have tried fn recent years to discover effective ways of 
.teaching the basic skills. I want to mention some of the teaching Ideas 
that researchers claim to have found effective In improving student? scores 
• on thp achievement tests In basic skills. . . 

Researchers say that students' learning of the basic skills would Improve 
if teachers allocated more time for basic skills Instruction. Do you 
think this is an effecTTve 'tecffnique? 

Very effective Effective Not effective - Detrimental 

. . * • - 

Explain your response: 



9. 



10. Would you want to participate in inservice education that helppd you find 
ways of allocating more time for instruction in the basic skills of reading, 
math, and language arts? 

Yes, very much Yes Islo No, definitely, not 
Explain your response: 



11. Have you ever received inservice education to help you find ways to allocate 
more time for basic skills instruction? , 

Circle: Yes No - 
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\2 Researchers say that students will Jearn the basic skills better If they , 
sW Sn trsk!*'Exan,ples of staying in task are listening to and watching 
^ •|oO?^(non?Erat1ons. answering your questions. 

Examples of off task behavior are daydrfeamlng. fooling around with class- 
mate? "a 1 ting for help from the teacher. Do ^ou think It Is true that 
7f stldeSts stay on taSk- more of the time, the? will learn the basic 
skills hetter? 

Yes, definitely true Yes No No. definitely not true 



Explain your response: 



13. Would you want to participate in In^ervice education that helped you 
teaching, techniques that keep students on task more of the- time during 
basic skills instruction? . , . • 

Yes. very much Yes No ^o. definitely not 
Explain your response: 



14. Have you every received inservice education to help you keep studpnts on 
task more of the time during basic skills instruction? 



Circle: Yes . No 
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15* Researchers say that students' scores on achleveitient tests w111 Improve 
1f teachers focus their Instruction on the basic skill content that Is 
covered on these tests. Do you think this Is true? 



No, definitely not true 



Yes, definitely true Yes No 
Explain your response: 



t 

16. Would you want to participate In Inservlce education that helped you 
bring your basic skills Instruction more in line with the content that 
is covered on standardized or district^developed achievement tests? 

Yes, very much Yes No No, definitely not 

Explain your response: 



17. Have you ever received inservlce education to help you Increase the 
overlap between what you teach in the basic skills areas and what is 
Included on standardized or district-developed achievement tests? 

Circle: Yes No 



PLEASE NOTE: Td like you to read a brief description of a teaching approach' 
that research has found may be effective in improving students' learning of 
basic skills in mathematics. [Ask teacher to read the description of Good and 
Grouws* model on the next page.] 
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An Approach to' Teaching Mathematics iii Elementary School 

Daily Review (first 8 minutes except Mondays) 

(a) review the concepts and skills associated with the homework 

(b) collect and- deal with homework assignments 

(c) ask several mental computation exercises | 

Development (about 20 minutes) " ^ I 

(a) briefly focus on prerequisite skills and concepts . ^ 

lb) focus on meaning and promoting student understanding by using 

lively explanations^ demonstrations, process explanations, - 

illustrations, etc. 

(c) assess student comprehension 

(1) using process/product questions (active interaction) 

(2) using controlled practice 

(d) repeat and elaborate on the meaning portion as necessary 

Seatwork (about 15 minutes) 

(a) provide uninterrupted successful practice 

(b) momentum- -keepi the ball rolling— get everyone involved, then 
sustain involvement 

(c) alerting— let students' know their work will be checked at end 
of period 

(d) accountability— check the students' work 

Homework Assignment 

(a) assign on a regular basis at the end of each math class 
except Fridays 

(b) should involve about 15 minutes of work to be done at home 

(c) should include one or two review problems 

Special Reviews 

(a) weekly review/maintenance 

(1) conduct during the first 20 minutes each Monday 

(2) (focus on skills and concepts covered during the previous 
week ^ 

(b) monthly review/maintenance 

(1) conduct every fourth Monday 

(2) foctrr*^ skills and concepts covered since the last 
monthly review 

18. Now that you've read the description, I'd like to ask you a few questions 
about your reaction to it. First, do you think students" math achievement 
scores would improve if teachers followed this teaching apprpach? 

Circle: Yes No 
Explain your response: 
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19. Wpuld you feel comfortable using this teaching approach? 
Circle: Yes No 
Explain your response: 



20, Would you want to participate in inservice education that helped you learn 
how to. use this teaching approach? 

Circle: Yes No 

Explain your response: 
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IV. DELIVERY SYSTEM FOR INSERVICE IN BASIC SKILLS OF READING . 
" TWTH . LANGUWsr'ATnT " 

21. Suppose that you were to participate In an Inservlce program to learn the 
math teaching approach that you just read about. Would you want to start 
tralnlrtg riaht away? Or would you want to participate In one or more 
sessions with a trainer and other teachers to address your concerns about 
this teaching approach? 

Start training right away 

Participate In sessions to address personal concerns 
Explain your response: 



22. If teacher selected "Participate In sessions" in #21, ask what concerns they 
would want to discuss. 



23. Researchers have found that a teacher learns new teaching ski lis. better If 
someone observes the teacher practicing the skills in his or her own 
classroom and then gives the teacher feedback based on the observational 
data. How would you feel about practicing new teaching skills while having 
someone observe you and give you feedback? 

Very positively Positive Negative Very negative 
Explain your response: 
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24. If someone were to observe you and give you feedback while you were 
learning a new teaching approach, who would you most like that person 
to be? (Classify as role of the persbo.) 



25. Would you prefer to learn a new teaching approach for Improving your 
basic skills Instruction all. at once? Or would you want an Initial 
Inservlce experience followed up at Intervals by further training and 
refresher experiences? 

All at once 

Further training and refresher sessions 
Explain your response: 



26. If you were to participate In Inservlce meetings to help you Improve your 
basic skills Instruction, where would you like these meetings to be held? 
CHECK ALL THAT APPLY (and explain your response). 

At n\y school 

At the school district offices 

At a university 

Other 

It doesn't matter 



27. Whom would you most prefer to conduct an Inservlce program on a new 
approach for teaching the basic skills? (Explain your response.) 

Another teacher 

A district specialist 

A professor ' 

Other- 

No preference 



It; 
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28. Inservlce meetings can be held at different times of the day and different 
times of the year. How acceptable do you find each of the following times? 
Assume that inservice attendance is part of your paid duties. 

Complete all the following: 

^ Very Mot Very , 

Acceptable Acceptable Acceptable Unacceptable 

a. early In the morning 

. before classes start - - ^ 



b. durlTig regular school >ours 

(If satisfactory replacement found) 

c. In the afternoon aft^r ^ 

school 

d. In the evening after school 



e. on Inservlce days when 
no classes are scheduled 

f. weekends during the school 
year 

g. just before the start of 
the school year 

h. during the summer 
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V. Or(GANIZATIONAL CONTEXT FOR I NSERVICE IN BASIC SKILLS 

29. Groups of teachers often participate together 1i> Inservlce programs to 
Improve their basic skills Instruction. What Is your first preference 
concerning who your fellow participants will be? Your second preference? 

Prefer just to learn with teachers from own school 

. Prefer just to learn with teachers frotn other schools 

Prefers ta learn with a group that Includes teachers from 
nv school and teachers from other school s • 

Explain your response: « 



30. How would you feel if your school principal participated in a basic 
skills inservice program with you? 



Very positive Positive Negative Very negative 
Explain your response: 
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VI. GOVERNANCE OF INSERVICE IN. BASIC SKILLS 

31. Suppose that a school district had the goal of Improving students' 
learning of the basic skills and that It was supported by' the 
administrators who felt all teachers should be Involved. 

Do you think that teacher participation In the Inservlce should be 
mandatory under such circumstances? 

Yes, definitely so Yes No No, definitely not 
Explain your response: 



32. What rewards and incentives would you want for participating In a basic 
skills inservice program for making Improvements in your basic skills 
instruction? 

Explain your response: 
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ADMINISTRATOR INTERVIEW SCHEDULE I 
PART ONE- 



Meredith D. Gall 
Fay Haisley 
Robert Baker 
Gavin Bird 



University of Oregon, College of Education 
Center for Educational Policy and Management 



This interview schedule is in two parts. This is Part I. 
Use Part Two to collect data on each inservice activity 
identified in Part I. 
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» ' Administrator's Name_ 

t School (or district)^ 

Date 



As you know, the purpose of this project is to learn about inservice 
experiences that your school district provides for its teachers. More 
specifically, I want to learn about your possible Involvement In sponsoring and 
designing these experiences over the past year. Before we start, though, I'd 
like to 3et som$ background information about you. Please keep in mind that you 
are free. to not answer any of these questions if you don't wish to. 

1. sex prrn 

2. Years of experience as a professional educator 

3. Age (21-25) (26-30) (31-40) (41-50) (514) 

4. Present assignment ^ 



5. Years as an administrator 



6. Years in this district as an administrator 

7. Ability level of students at your school 

very medium very 

low low ability high high 

8. How difficult is this school to administer? 

very very 
difficult difficult medium easy easy 

9. Please describe your school district as a climate for promoting 
inservice education of teachers. Are other adininistrators supportive 
of inservice education in the district? (Classify the district 
climate based on the respondent's responje^.) 

Highly Highly 
Unsupportive Unsupportive Neutral Supportive Supportive 

10. Now I'd like to ask about your .attitude toward inservice education 
for teachers. To what extent do you favor it? (Ask follow-up 
questions. Rate response on this scale.) 

Very Very 
Negative Negative Nieutral Positive Positive 

11. I want to review any inservice experiences you were involved in 
administering over the past school year and the preceding summer. 
I want to start from the end of classes in June 1981 and go month 
by month up to the present time. 

Before we start our review, we will need a definition of inservice 
education. 
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By Inservlce education we mean any activity that Is Intended to 
Improve a teacher's capacity as a. professional educator. The 
activity can be very brief (like sponsoring a guest speaker or a 
school Inservlce meeting). Or the Inservlce activity can extend over 
a school year or longer. To be classified as an Inservlce activity,' 
It should Involve the teacher In new learning. The learning can 
Involve new knowledge, attitudes, or skills. Also, the Inservice 
activity .can be done for a variety of purposes - for example, to 
improve an Individual teacher's Instruction (clinical supervision) or 
as part of a school Improvement project. 

We are only Interested in inservlce activities that you have had a hand 
in sponsoring or administering. Is this clear to you? Also, we are 
only Interested in inservlce activities that Involved at least some 
elementary teachefs. 



12. Now let's do a month-by-month review. (Write responses on next page.) 
June 1981 - do you recall anything that month? July 1981? (Continue 
up to present month. It's not Important that activities be recalled 
accurate! in terms of the month or months they occur^^ed.) Now that 
we've cpmpleted the review, are there any* inservlce activities that you 
overlooked? 
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(Pitfall; Watch time! Don't go Into detail at this stage.) 



Month 


No. 


FORMAL INStRVlCE ACTIVITY 


June oi 






iiii \j 




— ^ • • — ! 


At! Mil f ^ 






bepteniDer 




« 


uc uODer 






NovemDer 






ueceiTiDer 












February 




t ^ ■ 


ndrcn 




* 


Apri 1 






May 







(After the Interview assign numbers tc each separate focus of Inservlce 
activity. Get Part II Interview schedules ready. Use one for each Inservlce 
activity. The major criterion for deciding whether to group a set of Inservlce 
activities as a single unit Is whether the administrator views them as highly 
related to each other.) ' 
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ADMINISTRATOR INTERVIEW SCHEDULE I 

•I 

PART TWO 



Meredith D. Gall 
Fay Haisley 
Robert Baker 
Gavin Bird 



university of Oregon. College of Education 
Center for Educational Policy and Management 



in^arr?!""*^ ^'"^ ^"service activity identified 
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Administrator's Name_ 
Date 



Brief description of inservice activity # . 



A. TEACHER ^& STUDENT OBJECTIVES 

1. What were teachers supposed to learn from this inservice activity? Think 
about the specific knowledge, skills, or attitudes that were taught to 
teachers* 

(Steer away from student objectives or process activities. Probe after 
the initial response, e.g., Anything else? Can you be more specific? 
Circle whether each item is K (knowledge), A (attitude), or S (skill).) 
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U "171 '■'^ 



2. In what way were you Involved In selecting these objectives? 



3. Why were these objectives chosen? 



^. Can you identify any unintended effects of this activity? 



5»^ Many Inservice activities claim to help teachers help their students to 

n^IuSp^'V' ll^n'' ^"'•'•^•'ulum content, or to have betLr 

attitudes, ^as this true of this inservice activit^ {Circle- vpc/L 
If yes. ask: What were the specific Intended effects?) . ^ 



1 . 



1 1 1 



?rthrbasTskm.'I;r? ^o helpmg teachers instruct children 

in the basic skills of language, reading, and mathematics? 

U''^. ' Very ' . 

Pertinent Pertinent Pertinent ./ 
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C. DELIVERY SYSTEM 

9. An inservice activity is a process that has many components. I will name 
these components. For each component, please tell me whether you were 
involved in making decisions about it. If yes, I'll ask you to indicate 
what these decisions were, and why you made them. 

9a. READINESS ACTIVITIES, Yes/No 



9b. INSTRUCTIONAL PROCEDURE/MODE. Yes/No 



9c. LEARNING PROCESS. Yes/No 



9d. MAINTENANCE/MONITORING. Yes/No 



9e. TRAINING SITE. Yes/No 



9f. TRAINER. Yes/No 



9/^SCHEDLITnG. yes/No 
\ V V 



9h. BUDGET. Yes/No 



91. If money was expended on this Tnservice actTvity, where did it come from? 



D. ORGANIZATIONAL CONTEXT 



I^fHnr? ^■"^'"'^'^ 'n.^^^ ^'^^"^^ inservice process in some .way? (Circle 
.. yes/no.) If yes: Please describe the nature of your involvement. 



10a. If yes to 10: Why were. you involved in the ways that you described? 
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E. GOVERNANCE 



11. Did you involve teachers in selecting or designing the inservice activity? 
(Circle: yes/no.) If yes: In what way and for what reasons did you 
involve the teachers? ' 



12. Were you involved in deciding whether teacher participation in the inservice 
activity would be voluntary or mandatory? (Circle: yes/no.) If yes: 
What decision did you make, and why? 



13. Were you involved in deciding incentives or negative conse'quences that 

would be used to motivate teachers' participation in the inservice activity? 
(Circle: yes/no.) If yes: What decisions did you make, and why? 



F. PERCEPTIONS OF THE INSERVICE ACTIVITY 

f 

"•'aZtr*"''' °' ""''t''. "0 you feel pos,ti,e,y7 



; ■ . ■ 

15. What aspects of this inserwiVp art<u<<.w 

about? ' inservice activity, if any, do you feel negatively 



0 

IVorZi'"' about this activity which you feel should be 
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ADMINISTRATOR INTERVIEW SCHEDULE II 



Meredith D. Gall 
\ Fay Haisley 
Rob Baker 
Gavin Bird 



University of Oregon, College of Education 
Center for Educational Policy and Management 



Name 

S "■ ■ ^ 

Date 

Administrator Interview 

The purpose of this interview is to get your perceptions about basic skills. 
We want to learn- two things: 'how you feel about basic skills instruction and 
how you feel about the possible use of ihservice education, to Improve teachers' 
basic skills instruction. 

When I say "basic skills," I am referring to basic skills in reading, math, 
and language arts. 

If you are a principal - when I say "teachers" and "students" I am referring 
to the teachers and students in your schol . 

If you are a district administrator - when I say "teachers" and "students" I 
am referring to the elementary teachers and elementary students in your school 
district. 

BASIC SKILLS AS A GOAL OF SCHOOLING . 

1. How important do you think it is for teachirs to teach the basic skills to 

students? . ' • \ . 

Critical Important SI ightly, important Unnecessary , 
Explain your respons^e: 



2. How important do you think it is for teactters to teach the basic skills 

relative to other goals of the curriculum? 

Much Much 

more More Equally Less less 

important important important important important 

Explain your response: 
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How satisfied are you with the progress of your students In learning the 
basic skills? 



Reading 

Very satisfied 
Satisfied 
Oi ssati sfied 
Very dissatisfied 



Math 

Very satisfied 
Sati sfied 
Dissatisfied ^ 
Very dissatisfied 



Language Arts 
Very -satisfied 
Satisfied 
Dissatisfied 
Very dissatisfied 



Explain your response: 



II. MEASUREMENT OF BASIC SKILLS READING^ MATHj, LANGUAGE m 

The basic skills are usually measured by the use of standardized 
achievement tests. Are you familiar with such standardized tests as the ^ 
Stanford Achievement Test, the Comprehensive Test of Basic Skills i^^^^;. 
or the Metropolitan Achievement Test? 

Circle: Yes No 

(If yes, ask question 5, otherwise skip to question 6) 

If ''yes" to 4; how do you feel about the use of such tests to measure 
your students' achievement of the basic skills? 

Very positively Positively Negatively Very negatively 
Explain your response: , - 



The basic skills are sometimes measured by the use of achievement tests 
developed by school district staff. These tests are developed to measure 
the specific objectives of the district's curriculum. Are you familiar with 
the use of such local ly-developed tests i a your district or in other districts? 

Circle: Yes No . 

(If yes, ask question 7; otherwise skip to question 8) 



•7. If "yes" to 6: how do you feel about the use of ^uch tests to measure 
your students' achievement of basic skills? 

Very positively Positively ^ Negatively Very negatively 
Explain your response: "* 



8. Some administrators feel negatively about the use of standardized achievement 
• J!rJnc°^J ^''T^IJ ^"^^ developed by their district. They are negative 
because they feel that the achievement scores will be used to evaluate 
teachers performance and to hold them accountable for students' achievement. 
00 you have such feelings? 

Yes, very much so Yes, somewhat No 

Explain your response: ., 



III. lEMMM MODEl^ FOR BASIC 

Researchers have tried in recent years to discover effective ways of teaching 
the basic skills. I want to mention some of the teaching ideas that researchers 
in basic Skllll?" e^^ec^^ve in improving students' scores on achievement tests 

^' ^iVtf.r^^V '?^f that students' learning of the basic skilTs would improve 
If teachers allocated more tjme for basic skills instruction. Do you 
think this IS an ef fectTve ticTTnique? , jr^u 

Very effective Effective Not effective Detrimental 



Explain your response: 



10. Are you fami 1 iar. with any inservice programs to help teachers find ways to 
allocate mare time for basic skills instruction? 



Circle! Yes No 
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U. Researchers say that students will learn the basic skills better if they 
stay on task. Examples of staying on task are listening to and watching 
thTtl^cT^s demonstrations, answering the teacher's questions, and doing 
seatwork exercises. Examples of off task behavior are daydreaming, fooling 
around with classmates, waiting for help. from the teacher. Do you think it- 
is true that if students say on task more of the time, they will learn the 
basic skills better? 

Yes, definitely true Yes No No, definitely not true 
Explain your response: 



12. Are you familiar with any inservice programs to help teachers keep students 
on task more of the time during basic skills instruction? 

Circle: Yes No- 

13 Researchers say that ^tuc^ents' scores on achievement tests will improve 
if teachers focus their Instruction on the basic skill content that is 
covered on these tests. Do you think this is true? 

Yes, definitely true Yes No No, definitely not true 
Explain your response: 



14. Are you familiar with any inservice programs to help teachers increase the 
overlap between what they teach in the basic skills areas and what is 
included on standardized or d. strict-developed achievement tests? 

Circle: Yes No 

15. Would you advocate the use of inse-vice education: (a) to help teachers 
bring their basic skills instructioi more in line with the content that is 
covered on standardized or district-developed achievement tests; (b) to 
help teachers learn teaching techniques that keep student on task; and (c) 
to help teachers find ways of allocating more time for basic skills 
instruction? 

Yes, very much , Yes No No; definitely hot 
Explain your response: • 



PLEASE NOTE: I'd 1-ike you to read a brief description of a teaching approach 
that research has found may be effective in improving students' learning of 
basic skills in mathematics., [Ask teacher to read the description of Good and 
Grouws' model on the next page.] 
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An Approach to Teaching Mathematics in Elementary School 



Daily Review (first 8 minutes except Mondays) 

.(a) review the concepts and skills associated with the homework 

(b) collect and deal with homework assignments 

(c) ask several mental computation exercises 

Development (about 20 minutes) 

(a) briefly focus on prerequisite skills and: concepts 

(b) focus on meaning and promoting student understanding by using 
lively explanations, demonstrations, process explanations, 
illustrations, etc* 

(c) assess student comprehension 

(1) using process/product questions (active interaction) 

(2) using controlled practice 

(d) repeat and elaborate on the meaning portion as necessary 

Seatwork (about 15 minutes) 

(a) provide uninterrupted successful practice 

(b) momentum--keep the ball roning--get everyone involved, then 
sustain involvement 

(c) alerting^-let students know their work will be checked at end 
of period 

(d) accountability--check the students' work 

Homework Assignment 

(a) assign on a regular basis at the end of each math class 
except Fridays 

(b) shouid involve about 15 minutes of work to be done at home 

(c) should include one or two review problems 

Special Reviews 

(a) weekly review/maintenance 

(1) conduct during the first 20 minutes each Monday 

(2.) focus on skills and concepts covered during the previous week 

(b) monthly review/maintenance 

(1) conduct every fourth Monday 

(2) focus on skills and concepts covered sir^e the last monthly 
review 

16. Now that you've read the description, Td like to ask you a few questions 
about your reaction to it* First, do you think students* math achievement 
scores would improve if teachers followed this teaching approach? 

Circle: Yes No 
Explain your resp6nse: 
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17. Would you feel comfortable advocating the use of this teaching approach 
by your teachers? 

Circle: Yes No , ' 

E%r :n your response:'' 



18. Would you advocate the use o> inservice education to help teachers learn 
how to use this teaching approach? 

Circle: Yes No 
Explain your response: 



IV DELIVERY SYSTEM FOR INSERVICE IN BASIC SIOU^ OF RE^^ 
• MgmT TlNGUAGE ARTT" 

19 SuDDose that you were ta participate in designing an inservice program to 
helS?eachers learn the math teaching approach that you just read about. 
Sould you want to start training right away? Or would you want teachers to 
address their concerns about this teaching approach first.' 

Start training, right away • 
Participate in sessions to address personal concerns 

Explain your response: 
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20. Researchers claim that a teacher learns new teaching skills better if 
someone observes the teacher practicing the skills in his or her own 
classroom and then gives the teacher feedback based on the observational 
data. How would you feel about observing teachers and giving them feedback 
on thei r teaching skills? (If you are a district administrator, how would 
you feel about district principals performing these functions?) 

Vary positively Positive Negative Very negative 

Explain your response: 



21. Would you prefer to have teachers learn a new teaching approach for improving 
their basic skills instruction all at once? Or would you prefer an initial 
inservice experience followed up at intervals by further training and 
refreslier experiences? 

All at once 

Series of inservice sessions 
Explain your response: 



22. If you were to participate , in designing inservice meetings to help teachers 
improve their basic skills instruction, where would you like these meetings 
to be held? CHECK ALL THAT APPLY (and explain your response). 

At the teachers* school (s) 

At the school district offices - 

At a university ~ 

Other 

It doesn't matter 



23. Whom would you prefer to conduct an inservice program on a new approach 
for teaching the basic skills? (Explain your response.) * 

A teacher 

A district specialist . 

> A professor 

Other 

No preference 



24. Inservice meetings can be held at different times of the day and different^ 
times of the year. How acceptable do you finjl each of the following times 
for holding inservice meetings? Assume that inService attendance is part of 
teachers* paid duties. 

Complete all the following: 

Very Not Very 

Acceptable Acceptable Acceptable Unacceptable 

a. early in the morning 

before classes start 



b. during regular school hours 
(if satisfactory replace- 
ment found) 

c. in the a'ternoon after 
school 



d. in the evening after 
school 



e. on inservice days when 
no classes are scheduled 



f. weekends during the school ^ 
year 

g. just before the start of 
the school year^ 

h. during the summer 
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< V. ORGANIZATIONAL CONTEXT FOR INSERVICE .IN BASIC SKILLS 

25. Groups of teachers can be organized together in inservice programs to 
improve their basic skills instruction. What -is your first preference- 
concerning the grouping* of teachers? Your second preference?, 

». ' ^ ' 

(a) Prefer to orga,nize an irrservice group that just includes teachers from 

^e.same school ' ' 

(b) -Prefer to organize an inservice group that includes teachers from 

different schools in the district 

' ' ■' ■ • 

26. How would you feel , about participating in a basic skills inservice 
program, with your teachers? 

Very positive ^ Positive Negative Very negative 
Explain your response: * 



VI. GOVERNANCE OF INSERVICE IN BASIC SKILLS 

27. Suppose that a school district had the goal of improving students' learning 
of the basic skills. Do you think that teacher participation in the 
inservice should be mandatory under this circumstance?* 

Yes, definitely so- Yes No. No, definitely not* 

Explain your response: 



28. ,What rewards and incen^tives, if any, would you advocate .for teachers who 
participate in an inservice program to make improvement In their basic ^ 
skill s instruction? 

Explain your response: . • 



APPENDIX I 



The Relationship Between Inservice Practices 
and Productivity in Basic jSkills Instruction. 
(Gall/Haisley/Baker/Perez) 



FRir 



CODE BOOK 
for 



Interview Schedule 1. 
(Part Two) 
Topics of Inservice Actj.vities 
Coding by Gall/Baker " 



Center for Education Policy 

and Management, 
University of Oregon, „ 
. EUGENE, - OREGON. 

November, 1982. ' 
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Description of procedures > , 

% 

Step One Transcription 

From the interview Schedule 1 (part two) write a brief 
summaiy of all the activities obtaining information from the 
followingi ^ - ^ 

- title of the activity (written as a one sentence 
description of the inservicel 

- A. Teach er Objectives listed ass 

1* Targeli ^mpetencies according to knowledge, 

attitude or skills focus. 
2. Side or long term effects according to 

knowledge, attitude or skills emphasis. 

Step Two I Code the bri-ef summai?ies according tot 

A. Topics covered 

B. Links with direct instruction strategies 
G. Links with district curriculm ri 

D. Links with achievement test scores ~ 

(See Table One for coding scores) 

Hules for Cgding ' 
A Topics i - 

* 

1. If an inservice activity covers more than one topic, 
code the activity for each tppic covered. For example, an ' 
activity in which teachers learn to use art in social studies 
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would be scored ^twice (exQ.eption is language arts- see rule 

• Teacher Activity. ^ " Topic '( 

' I.D. No: • Noi, , » Not 

11 . 01 15 

2. Sco^e I.T.I^P. (Madeline Hunte,r Teaching Method), 
school effectiveness, cotnputer education.^ learning centers 
'and similar activities as 63' (general academic), unless 

there is a specific reason to do otherwise. 

3. If a code topic b'ecoraes "clarified"'^ when additional . 
information is supplied from a later source .then return and 
re-code all previous scopes for this activity, (note, exception 
to this in rule 5) * " 

\, If an activity cont^i«^ore than one language" arts , 
topic (eg. writing and reading) s^^^as 05 (language arts) 
NOT as separate scores of 13 (reading) and 1? (writing). 

5. When scoring for T^,.Timr with (ifrect instruction 
or T.ink with tests , coding shpuld be ^one only on the basis 
of data provided by the teacher and included^the transcriptio 
summary. Even if data is known^about this topic Score only 
on the basis of data provided, (note, this does. not apply 
to scoring, C T.inks with d i -^tT-let curriculum) 



189 



B Links with^ direct instruction strategies 

1. Score ^or those activities which describe! 

(a) .monitoring behavior - in which a teacher asks 
^ " pupils to perfgrm a desired 'Ibasic Skill" 
\ ^ . (eg. work book practice accompanied by ^ 
teacher ' monitoring) 
^ - (b) reactive/coyrective behavior - to help a 

student when he or she is unable to provide 
^ f the desired response. 

(q) instructional variablesi 

(i) allocated time 

(ii) engagement rate - ^ 

(iii) student engaged time 

(iv) taking dnto account students' pri?or 
learning 

(v) instruQtlpnacl overlap - match between 
ii^structiartal content and achievement 
test content. 

2. See under A. Topics rule #5. 
C Links with district curriculum 

1. Curriculum refers to district or school mandated 
programs. • ^ ^ . 

» 

2. Score "1." for those activities which describe topics 
clearly linked to a district responsibility for the curriculum 

190 



(eg. adoption of a program, such as Holt Reading Program or 
' Math Their Way). , . ' 

• 3. Score curriculum objectively. That is, if you can 
infer the activity is being" used to support school or district 
curriculum implementation score it as "l". Inferences usually 
are made when another teacher activity provides datd which . ^ 
^ can be related to the activity currently being coded, 

(note: exception rule #' 5 Topics j 

l^. I.T.I. P. is a district - wide adopted curriculum • 
in this project. • 

D Links with test scares . 

1. Score "1" for those activities whicl^ are desired 
to improve test scores or pupil grades generally, (notet ^ 
exception rule 2). . 

2. Do not score "1" for those activities which describe 
tests for diagnostic or placement purposes. For example, do 

ijnot include subject tests, (reading, mathematics) which are 
jpart of a regular program. ^ ^ 

'3. . "Tests" do not have to' be only standardized tests . 
\ ' such as C.A.T., S.A.T. or C.T.B.S. but need only have an , 

achievement oP outcome orientation. 
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TABLE ONE 



Column ( s ) ' 
(for use with 
S.O.S. computer 
editor file) 


Code 
Score 


. Category or Code Name 

'4 

a 


Examples of Coding - direct quotations 


Columns ^ - 
1.2 ^ ' . 




} 

Teachers' I.D. Number 


1 






Inservice Activity Noi 




5.6 




A. TOPICS 




)-« 

rs>N 

(■ 


01 

> 


Art 


eg.'(i) A workshop on how to> use left over 
scraps to make art projects. 
(ii)Two workshops on art and oceanography 


•f < 


02 


Distri'cty School 
policies 


eg.(i) Inservice on school budget to help 
answer public questions. 
(ii)District andl^ bull ding orientation to 

learn about policy regulations'. * 
(iii)Meeting on school tax base. 


1 * ' 

r, 

- o 


03 


General Academic 

r 


. ^ 1 

eg.(i) To train teachers in the mechanics of 
standardized testis. 
([i4)A lecture on 'total school environment 
research. • pU' t 
(iii)Inservice on the microcomputer - ^--'-^ 
company rep. 

(iv)A lecture on the ,right/lef t brain and 
how it affects my teaching. 

yy J X. 1.1. Jr. - Maaexine .nunxer program — < 
district wide; . ^ 
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TABLE ONE (conf'd) 




, Column (s) 

(for use with 
S«0«S« computer 
editor file) 


Code 
Score 


Category or Code Napie 


Examples of Coding - direct 
quotations 


't Columns 

% 5.6 , ^ . 


- "• ■ 

OZf 


Handwriting 


eg«(i) Inservice on adoption of hand- 
Writing program - learned not 
to join two S^3. 
(ii)Inservice on interfacing italic 
and cursive handwriting learned 
that the two arp not in conflict. 


i 

m vO 




— ■ - ■'- ■ — 1. 

Language Arts J? 

• • 

*> • 


eg.(i>.How to do direct inatruction in. 
language arts and reading* 
(ii)"Step aheald" inservice - to 
develop motivational materials 
for reading and writing. 


Q ^ ^ 

1 


06 


\ Career Education ^ 
* 


eg. (i) Learned about the role of career 
ed in specicJL ed. 
(ii)Inservice on career ed. - leame( 
how to help students feel good 
about their career choices. 


■ » 

1 


07 

f 


Management/Di s cipl ine 


eg. (i) An inservice on time*- raanagemen' 
techniques for teachers. 
(ii)An inservipe on discipline - 

strategies for achieving positivi 
classrooift behavior. 




< 

On. 


MatherAatics 

• 


eg. (i) '-'Math Their Way" - a district 
sponsored inservice / 
i (ii)An E.S.D. sponsored progj-am calL 
"Thursday Math". 
(iii)An informal inservice to discuss, 
the mechanics of a pilot program 
in math and problem solving 
strategies. 
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^PAbLE one (cont'd) 


* 


doltunn(s) 
(for use with 
^ S.O.S. computer 
editor file) 


Code 
Score 


Category or Code Name 


Examples of .Coding - diirect .quotations 


Coluhms 
5.6 


09 

> 


lAusic 


eg.(i) A P.E. workshop combined with music* 
(ii)A music workshop led by the^ district 
(iii)A music stnd P.E. workshop to listen 
to rhythm and movement in music. 


ft 

r 


10 


^ Mental Hygiene 


eg.(i) Inservice on mental- health and, 

stress to* help myself and my' student 
to relax. 

(ii) A workshop on h6w to help students 
cope with a loss eg. dekth of a 
parent or family split up. ' . , ^ 


ir « 

% 


11 

f 


Personal/General 
Professional 

r 

t 
• 


eg.(i)'A workshop for SELCO representatives 
' , to learn how SELCX) "takes' care of 

employees". 
(ii)Rape awareness - how to protect 
fnysalf at home and at night. 
(iii)Two U. of 0. sessions on discrimin- 
ation.^ 

(iv Mental health and stress for 
^ teachers. - 


k 


12 


Physical" Educ. 


eg.(i} A P*E. workshop on how to use the 
teachers* guide and how to do F.£U 
exercises with music. * 
(ii)A U. of 0. workshop for school 
coaches.* 

(iii)A P.E. workshop put on by distric.t 
* teachers. 
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TABLE ONE (dont'd) 




Coluran(sJ 
(for use with 
S.O.S.comJiuijer 
editor file) 


Code 
Score 


^ Category or Code Name 


Examples of Coding - direct 
quotations 


Columns 


■ • 


Reading 


eg.(i) The new Holt Reading Program - 
4 district sponsored sessions. , 
(ii)An inforraEa school level inservice 
to develop reading. 

(iii)A series of 3 workshops put on 
by International Reading Assoc. 
(iv)Managing reading by objectives. 


■f 


^ 
* 


' Science/Energy/ 
Environment - 


eg.(i) An inservice program on science 
and energy run by E.W.fi.B. 
(ii)An E.S.D, - E.W.E^B. wprkjshop on 
"Wasty Watt" curriculum kit for 
K-2. 

(iii)Two workshops on art and 
oceanography. 


•• 


15 


^SocisuL Studies 


eg.(i) State inservice on Indi^uis *- 

learned how Indiein culture dove- 
tails with social studies texts. 
(ii)Human relations inservice on 

South East Asian cultures to help 
E.S.L. kids feel accepted. 
(iii)Inservice on multi- cultural 
awareness.' 


II 


16 


Spelling 


eg.(i) Inservice on the adoption of 
;v spelling program - learned 
^ that 10-20% is phonetic and 
rest is irregular. 








• 
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TABLE .^NE (cont'd) 



Column(s) 
(for use with 
S.O.S. computer 
editor file) 



Columns 
5.6 



ON 



Code 
Score 



17 



18 



Cat^gory^ or Code Name 



Examples of Coding - direet 
> , quotations 



Writing Composition 



Special Education/ 
Gifted and Talented 



eg.(i) Three all-day sessions 

"Teaching Kids, to Write 'Hight'^. 
(ii)Inseryice on the improy^roent * 
of students writings- learned 
about wholistic writing and 
how to implement itt 

' (iii)Inservice on creative story- 
writing. ^ 

— z — '-^ '■ ^ : 

eg.<i) Learned about the role of 
career ed* in special ed.' 
<ii) Conference on 'sight impaired 
children and what the wotld 
looks like 'to one of my h/cap 
children • ^ 
' (iii)Talented and gifted conference. 



Column 
7 



B. LiYiks with direct instruction 



II 




0 


• No link with direct 
instruction 




C3 

v* * 




k 


-* 


1 


Linked with direct 
instruction 








ColuiTin 
8 

♦ 




c. • 


Links with district curriculum 








. Ul—l ; ■ 



0 .No link 
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Linked with 
curriculum 



TABLE - ONE (cont'd) 



uoiuninCs)" * 
(for use v/ith 
S.O.S. computer ' 
editoi* file) 


Code 
Score 


■ \ 

Category or Code Name 


Examples of Coding - direct 
^ quotations 


Qolumn 
9* 

o 


D. 


Links with achievemfent tests 




M 


0 

T 


. No Link- 

r 


**• 

t 



"T — ■ 

l" Linked with tests - 



